-- Logs begin at Wed 2022-09-21 09:24:57 UTC, end at Wed 2022-09-21 10:27:04 UTC. -- Sep 21 09:50:18.650406 dv-cinder-855479-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 21 09:50:18.658995 dv-cinder-855479-2-smb devstack@keystone.service[81466]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 09:50:18 2022] *** Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: nodename: dv-cinder-855479-2-smb Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: machine: x86_64 Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: clock source: unix Sep 21 09:50:18.660986 dv-cinder-855479-2-smb devstack@keystone.service[81466]: pcre jit disabled Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: detected number of CPU cores: 4 Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: current working directory: / Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: detected binary path: /usr/bin/uwsgi-core Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: your processes number limit is 47680 Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: your memory page size is 4096 bytes Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: detected max file descriptor number: 2048 Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: lock engine: pthread robust mutexes Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: thunder lock: enabled Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 21 09:50:18.661443 dv-cinder-855479-2-smb devstack@keystone.service[81466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 09:50:18.706428 dv-cinder-855479-2-smb devstack@keystone.service[81466]: Python main interpreter initialized at 0x55cb84a7b9c0 Sep 21 09:50:18.706536 dv-cinder-855479-2-smb devstack@keystone.service[81466]: python threads support enabled Sep 21 09:50:18.706536 dv-cinder-855479-2-smb devstack@keystone.service[81466]: your server socket listen backlog is limited to 100 connections Sep 21 09:50:18.706536 dv-cinder-855479-2-smb devstack@keystone.service[81466]: your mercy for graceful operations on workers is 90 seconds Sep 21 09:50:18.706790 dv-cinder-855479-2-smb devstack@keystone.service[81466]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 09:50:18.706909 dv-cinder-855479-2-smb devstack@keystone.service[81466]: *** Operational MODE: preforking *** Sep 21 09:50:18.707240 dv-cinder-855479-2-smb devstack@keystone.service[81466]: *** uWSGI is running in multiple interpreter mode *** Sep 21 09:50:18.707240 dv-cinder-855479-2-smb devstack@keystone.service[81466]: spawned uWSGI master process (pid: 81466) Sep 21 09:50:18.707461 dv-cinder-855479-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 21 09:50:18.708050 dv-cinder-855479-2-smb devstack@keystone.service[81466]: spawned uWSGI worker 1 (pid: 81475, cores: 1) Sep 21 09:50:18.708374 dv-cinder-855479-2-smb devstack@keystone.service[81466]: spawned uWSGI worker 2 (pid: 81476, cores: 1) Sep 21 09:50:18.709591 dv-cinder-855479-2-smb devstack@keystone.service[81466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 09:50:23.019673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 09:50:23.019673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: from cryptography.utils import int_from_bytes Sep 21 09:50:23.020441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 09:50:23.020441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: from cryptography.utils import int_from_bytes Sep 21 09:50:23.022023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 09:50:23.022023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: from cryptography.utils import int_from_bytes Sep 21 09:50:23.022540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 09:50:23.022540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: from cryptography.utils import int_from_bytes Sep 21 09:50:23.070515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 09:50:23.070713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 09:50:23.070887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] command line args: [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 09:50:23.071158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 09:50:23.071336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ================================================================================ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 09:50:23.071597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] admin_token = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.071842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_dir = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.072029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.072212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] config_source = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.072377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 09:50:23.072458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] debug = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.072576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 09:50:23.072656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.072896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] command line args: [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 09:50:23.072968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 09:50:23.073159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ================================================================================ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 09:50:23.073376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] admin_token = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_dir = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.073937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_config_append = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] config_source = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] debug = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_dir = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.074934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_config_append = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.075970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_dir = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.076910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.077991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] publish_errors = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.078979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079239 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.079884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] standard_threads = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] publish_errors = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.080940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_journal = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_json = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_stderr = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.081882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] use_syslog = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] standard_threads = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.082639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.082931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.082931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.083195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.083324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_journal = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.083457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.083585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_json = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.083712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.083857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_stderr = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.083857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] use_syslog = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.084110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.084255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 09:50:23.084428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.084562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.084698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.084892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.085024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.085149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.085283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.085423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.086163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.087757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.087911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.088955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.089996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.090670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.091222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.091358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.091497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.091631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.092968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.093895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.094964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.095896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.096934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.097924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.098871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.099900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.100942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.101105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.101729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.101869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.101998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.102975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.103962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.104994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.105911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.106876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.107926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.108985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.109879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.110817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.111957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.112998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.113972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.external = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.114924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.115940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.password = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.external = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] auth.token = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.116732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.password = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] auth.token = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.117989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.118992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.119972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.120978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.121938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.122935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.123936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.124975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.125938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.126984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.127968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.128922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.129965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.130973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.131853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.132861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.133993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.134969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.135928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.136883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.137931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.138916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.139875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.140852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.141970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.142959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.143993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.144866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.145913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.146957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.147913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.148487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.148676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.148757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.148934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.149983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.150982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.151938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.152951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.153893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.154933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.155975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.156931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.157966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.158914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.159988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 09:50:23.160653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.160904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.161141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.161388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.161626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 09:50:23.161800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 09:50:23.190169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.190428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.190601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.190689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.190839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.191069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.199163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.199600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.228558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.228787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.228893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.229066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.282416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.282801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.330720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.330955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.331836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.332076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.488898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.489032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.489114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.489249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.489340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.489473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.513644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.513986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.514997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.515082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.515219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.515441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.526485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.526765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.539906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.540929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.541055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.541141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.541220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.541353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.541578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 09:50:23.558485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.558695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 09:50:23.558836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.559046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 09:50:23.559253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 09:50:23.559393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.559534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.559626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 09:50:23.559798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.559888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.560058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.560140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.560319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.560399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.560628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.570920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.571040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.571207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.577943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.578262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.580912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.581204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.581291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.581491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.581596 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.581779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.581877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.582916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.583820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.584012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.607292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.607682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.608771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.609060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.609201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.609496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.613742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.614034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.614276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.614361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.614569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.614857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.621253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.621545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.621870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.622174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.627407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.627724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.628286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.628942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.629957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.644997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.645279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.645503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.645790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.649190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.649647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.652426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.652726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.652882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.653183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.656937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.657363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.660074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.660574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.663276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.663581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.664351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.664434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.664654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.664736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.664938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.665023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.665223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.665305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.665507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.665791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.681237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.681528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.681798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.682066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.682222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.682551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.682827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.683099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.688876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.689999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.690412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.691592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.691921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.692205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.693137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.693423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.695464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.695757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.696055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.696340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.696656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.696751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.696956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.697245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.697535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.697929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.707931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.708229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.708510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.708792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.709172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.709257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.709466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.709559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.709751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.709833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.710036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.710447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.711281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.711579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.725937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.727336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.728925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.730301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.731828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.733295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.733394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.734794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.734889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.735078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.735481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.736266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.736556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.736977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.741872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.743360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.743449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.744905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.746269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.746666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.746959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.747245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.747838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.748243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.748553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.748819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.755048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.755343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.755630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.756694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.756995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.757284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.763098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.763389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.763678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.763962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.764241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.764520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.764704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 09:50:23.764789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.764998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.765933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.766987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.767290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.767557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.767844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.768116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.768400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 09:50:23.801342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb84a7b9c0 pid: 81475 (default app) Sep 21 09:50:23.803183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb84a7b9c0 pid: 81476 (default app) Sep 21 09:50:23.804744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d311-7c87-42f8-beab-c7071541078a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:23.805032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d311-7c87-42f8-beab-c7071541078a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:23.805308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d311-7c87-42f8-beab-c7071541078a None None] PATH_INFO: `/v3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:23.809505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Sep 21 09:50:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:30.730694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:30.731205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:30.731291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:30.735546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:50:30.740917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:30.741380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:30.741512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:30.812136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: INFO dbcounter [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] Registered counter for database keystone Sep 21 09:50:30.831044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG oslo_db.sqlalchemy.engines [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 09:50:30.837766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writer thread running {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 09:50:31.017103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG passlib.handlers.bcrypt [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 09:50:31.017413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG passlib.handlers.bcrypt [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 09:50:31.075487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:31.077121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:31.218348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 09:50:31.675527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:31.745398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: INFO dbcounter [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] Registered counter for database keystone Sep 21 09:50:31.767297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 09:50:31.774470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writer thread running {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 09:50:31.891271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c473-3666-424b-ab30-4f0bdd2a7a7f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:31.895545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:31.896173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:31.896460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:31.896734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:31.905438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:31.956047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 09:50:31.956337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b200c-5643-4e19-a110-4c8bb7b50c6d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:31.966298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Sep 21 09:50:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 09:50:31.972494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:31.989097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f81559-b0d1-47de-a5d6-4a9636dbaa15 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:31.993603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:31.994765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:31.995054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:31.995334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] PATH_INFO: `/v3/projects/55e542a5235d4f308d797e26281f9ea9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:31.996931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] RBAC: Authorizing `identity:get_project(project_id=55e542a5235d4f308d797e26281f9ea9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:32.049878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 09:50:32.050230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f735-b9fe-4eae-9316-387a89f55659 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:32.054820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Sep 21 09:50:31 2022] GET /identity/v3/projects/55e542a5235d4f308d797e26281f9ea9 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:34.190636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0961-93eb-4ff6-aff6-2bc64454bfb1 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:34.191148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0961-93eb-4ff6-aff6-2bc64454bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:34.191329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0961-93eb-4ff6-aff6-2bc64454bfb1 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:34.195346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:50:34.200693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:34.201071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:34.201243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:34.221652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:34.223215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:34.233897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 09:50:34.508933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa0961-93eb-4ff6-aff6-2bc64454bfb1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:34.521001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa0961-93eb-4ff6-aff6-2bc64454bfb1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:34.525722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:34.526355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:34.526641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:34.526917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:34.534502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:34.536284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e0c22-2d6c-47c5-aa3a-e4e37dcfadc0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:34.545578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Sep 21 09:50:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 09:50:34.551073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:34.560276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c544bc-0552-4431-86aa-b21ee2d1b98c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:34.564704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:34.565340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:34.565625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:34.565903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:34.567321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:34.569159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32b62-dc66-4306-9b9f-7d839280d719 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:34.570745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Sep 21 09:50:34 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:36.818790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb0b0-b006-4d7c-adcc-b45c72a12ad2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:36.819335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb0b0-b006-4d7c-adcc-b45c72a12ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:36.819335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb0b0-b006-4d7c-adcc-b45c72a12ad2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:36.820680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:36.826208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:36.826700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:36.826879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:36.841523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf77d-b7d2-479e-9aad-755025f9b4ed None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:36.842177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf77d-b7d2-479e-9aad-755025f9b4ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:36.842380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf77d-b7d2-479e-9aad-755025f9b4ed None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:36.843694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:50:36.846093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:36.847340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:36.849158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:36.849444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:36.849720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:36.891832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG passlib.handlers.bcrypt [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81476) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 09:50:36.892226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG passlib.handlers.bcrypt [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81476) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 09:50:36.930738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:36.941797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:36.943454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:37.044780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:50:37.220574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.247982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.315360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.334790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba619f1-51d1-4a4a-b2bf-cd232a1a5e5f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.370719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.371439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.371667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.371944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.383715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:37.392630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:37.393643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:50:37.394757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:37.400729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.429328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6adfc0-a225-4933-bc9d-7e25d8300e14 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.431914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.469653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.470567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.470855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.471132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.498795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.518506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea62f6-0f29-453a-bf2d-74a92ec4f166 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.543453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:37.545036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:37.554470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.555093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.555379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.555662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.556348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:37.556654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:37.558089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:37.569793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:37.575375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.649134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 09:50:37.654801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.658174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.679994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0637c0-9874-4787-82f4-0899de9ba38d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.720462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.721109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.721546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.721935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.723274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:37.725033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:37.727621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:37.732801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.747588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.764602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e77d-7813-4e6f-9def-004d1dc22c23 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.800005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.800877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.801160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.801435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.822486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:37.823901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:37.839822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808bd80-4244-4251-8bca-6afeca6e7f0b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:50:37.845421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:37.846622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:50:37.847597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:50:37.847597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:50:37.847597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:50:37.847597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:50:37.852604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.884377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:37.885016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:37.885294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:37.885563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:37.886724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:37.888174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:37.889730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:37.895782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:37.913418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:37.976364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031f4d-36b5-486e-8a7f-392d17363fc6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:37.990722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:38.013555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:38.014174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:38.014483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:38.014754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:38.015151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc59f2a-a756-4a34-ba71-db8c5a6df316 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:38.015401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:38.015707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:38.017098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1f0d-54f8-49d0-bc77-02a5b1ead8b8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:38.050280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:38.077535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:38.078928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:38.079421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:38.079891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:38.081286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.domain.id=default, user.id=9984ac48f53d4200ac584a0c0d9f52b9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:38.081840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:38.084582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda94d-c03a-4f94-a7fe-f141a5b713ca None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:38.097406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Sep 21 09:50:37 2022] GET /identity/v3/role_assignments?user.id=9984ac48f53d4200ac584a0c0d9f52b9&scope.domain.id=default&role.id=501008bc08bd430ea940373b81e53c53 => generated 233 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:40.623187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b7b1-b86e-488d-b0cd-f304d63b4743 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:40.624789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b7b1-b86e-488d-b0cd-f304d63b4743 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:40.625529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b7b1-b86e-488d-b0cd-f304d63b4743 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:40.628258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:40.636763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc127d67-aadf-438e-b350-2c96cb026589 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:40.637570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc127d67-aadf-438e-b350-2c96cb026589 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:40.637570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc127d67-aadf-438e-b350-2c96cb026589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:40.663937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bc127d67-aadf-438e-b350-2c96cb026589 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:40.665180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bc127d67-aadf-438e-b350-2c96cb026589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:40.765347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:40.824009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb4984-9422-42e0-80e9-f8974b0b2cdb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:40.825046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb4984-9422-42e0-80e9-f8974b0b2cdb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:40.825795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb4984-9422-42e0-80e9-f8974b0b2cdb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:40.828466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:40.836635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:40.837029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:40.837258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:40.865459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:40.866777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:40.969766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:41.509976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb4984-9422-42e0-80e9-f8974b0b2cdb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:41.512649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:41.519309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:41.771620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7f40-5701-43d6-ac0f-e3f0b4a3f502 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:41.773862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb4984-9422-42e0-80e9-f8974b0b2cdb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:41.799929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:41.823626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:41.824286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:41.824571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:41.824840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:41.847002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:41.848508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:41.850153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:41.851606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:41.852090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:41.852576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5c04d254-1a6d-4350-848c-aa7841996499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:50:41.894217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:41.895942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:50:41.898024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:50:41.898024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:50:41.898024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:50:41.902504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:41.914610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 13/26] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:41.917076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c583f8-9866-4c89-8b95-546114a54c47 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:41.917586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c583f8-9866-4c89-8b95-546114a54c47 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:41.918691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c583f8-9866-4c89-8b95-546114a54c47 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dddd34c2-5e71-48f7-bbb7-a9f97d8d3000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:41.924524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:41.927973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:41.932298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:50:41.934520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:41.934520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c583f8-9866-4c89-8b95-546114a54c47 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:41.934919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:41.934919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:41.942313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:41.942313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.003517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:42.005475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:42.190474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:42.197210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c583f8-9866-4c89-8b95-546114a54c47 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:42.208134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:42.210580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:42.258094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:42.258746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.259025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.259299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.259946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:42.260261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:42.261661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588de9e-c947-48ed-a11d-ab2706aaa803 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:42.300366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:42.302970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3b8b-9191-46a8-b187-06b172996880 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.304581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3b8b-9191-46a8-b187-06b172996880 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.308913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3b8b-9191-46a8-b187-06b172996880 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.311833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:42.318075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc3b8b-9191-46a8-b187-06b172996880 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:42.379263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:42.480853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e17be-9e31-442f-b6c1-d24e5afe1387 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:42.551699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:42.553107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.553670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.554169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.555472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:42.556025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:42.558714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9020e-29f9-4c9b-8920-9ddf59e6b0f0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:42.583625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:42.586876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.587080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc3b8b-9191-46a8-b187-06b172996880 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:42.587769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.588490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.633640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:42.633902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:42.634549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.635110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.635569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.636197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:42.636834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:42.638523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:42.751075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:42.786254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:42.787846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:42.811356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:50:42 2022] POST /identity/v3/projects => generated 301 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:42.813388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:42.922884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:42.945562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba61176-0fc6-47dc-8428-969393e43beb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:42.949766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5bc9-5f5d-4f7d-bdf2-773457fe218b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:42.987206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:42.987627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.987922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.988210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.988926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:42.990371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:42.993793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:42.994947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:42.995469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:42.995953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:42.999069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:43.001296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8379a86-122b-4eb1-85ef-7ccd4d55611a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:43.005393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:42 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:43.008911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aa7aa-c088-4ee0-925a-749b5eb4af55 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.009396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aa7aa-c088-4ee0-925a-749b5eb4af55 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.009834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aa7aa-c088-4ee0-925a-749b5eb4af55 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.011956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:43.020286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.020737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.021614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.065660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:43.067338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:43.161414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 20/37] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:50:43.162476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:43.242221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 18/38] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 21 09:50:42 2022] POST /identity/v3/roles => generated 225 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:43.266906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:43.291998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8449abf-ee76-4e13-bc44-f7c7759307ef None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:43.302613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:43.333804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:43.334504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.334792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.335642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.336892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:43.338595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:43.340280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 21/39] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:43.352523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:43.455332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:43.487184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812c96-0325-46ac-9c4d-431145f008e9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:43.533524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:43.534133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.534463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.534754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] PATH_INFO: `/v3/domains/default/users/9984ac48f53d4200ac584a0c0d9f52b9/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.538681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9984ac48f53d4200ac584a0c0d9f52b9, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:43.540232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52609ac7-f2cd-459f-9429-c29f49bc2b27 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:43.576279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Sep 21 09:50:43 2022] PUT /identity/v3/domains/default/users/9984ac48f53d4200ac584a0c0d9f52b9/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:50:43.583744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0b94-79f6-4ab9-9940-376ab859c036 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.584380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0b94-79f6-4ab9-9940-376ab859c036 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.585391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0b94-79f6-4ab9-9940-376ab859c036 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.588513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 23/41] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:43.591308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a0b94-79f6-4ab9-9940-376ab859c036 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:43.609431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534393a-b3d1-4454-acef-beffc74f8b4d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:43.610030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:43.688301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:43.688954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.689310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.689518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.690314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:43.693012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df3d9-ef4f-4397-85c2-895e50bdde69 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:43.726398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 19/42] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 21 09:50:43 2022] POST /identity/v3/roles => generated 219 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:43.728979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.729401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.729743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.754750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:43.757846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:43.792892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a0b94-79f6-4ab9-9940-376ab859c036 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:43.839824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffbf1d-a985-4601-872a-34127190061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:43.840788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffbf1d-a985-4601-872a-34127190061b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:43.840788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffbf1d-a985-4601-872a-34127190061b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:43.841048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffbf1d-a985-4601-872a-34127190061b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:43.842793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffbf1d-a985-4601-872a-34127190061b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:43.844349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffbf1d-a985-4601-872a-34127190061b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:43.846294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 24/43] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:43.859081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffbf1d-a985-4601-872a-34127190061b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:43.899683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 20/44] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:44.016117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:44.057945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffbf1d-a985-4601-872a-34127190061b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:44.107287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:44.107921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:44.108195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:44.108524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:44.109272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:44.110768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d99be-cc27-4619-86a7-b205a6150435 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:44.150290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 25/45] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:50:43 2022] POST /identity/v3/projects => generated 312 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:50:44.206108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:44.250366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:44.467250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a8591-2f6e-4bbd-9971-915c53088a87 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:44.515687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:44.516651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:44.517103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:44.517558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:44.518638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:44.520320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e64771-1572-4ad7-a1d8-69f8924d9b10 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:44.541842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 21 09:50:44 2022] POST /identity/v3/roles => generated 223 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:46.160395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df3d-e61c-4257-8bc7-f8c9b6f70952 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.160914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df3d-e61c-4257-8bc7-f8c9b6f70952 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.160994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df3d-e61c-4257-8bc7-f8c9b6f70952 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.162369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 26/47] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:46.168370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713530-9a63-42da-8b35-4114381ba524 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.168852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713530-9a63-42da-8b35-4114381ba524 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.168948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713530-9a63-42da-8b35-4114381ba524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.187619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4c713530-9a63-42da-8b35-4114381ba524 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:46.188818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4c713530-9a63-42da-8b35-4114381ba524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:46.258528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:46.523401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cca0e-a6d4-4c6a-a624-626714bc1d6d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.523610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cca0e-a6d4-4c6a-a624-626714bc1d6d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.523887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cca0e-a6d4-4c6a-a624-626714bc1d6d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.525241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 27/49] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:46.530575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.530874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.531159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.534312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cca0e-a6d4-4c6a-a624-626714bc1d6d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:46.549427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:46.550662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:46.571539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:46.622159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 23/50] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:46.647853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cca0e-a6d4-4c6a-a624-626714bc1d6d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:46.674686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:46.685133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:46.685780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.686053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.686355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.698317 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:46.704547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:46.705375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:50:46.706142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 28/51] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:50:46.712025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:46.810314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a01040-362a-400e-9422-ded0cc9d6215 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:46.844284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:46.844888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.845167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:46.845437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:46.846098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:46.846427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:46.847813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:46.855975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 24/52] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:46.861507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:46.899971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:46.919409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:46.961948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322650-7ff7-4bf5-aee3-d683c957279f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:46.998264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:46.999391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:46.999817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:47.000105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:47.001253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:47.002821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:47.003275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead501d3-a2b3-483a-84c1-e26f2f867cfa None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:47.004347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 29/53] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:46 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:47.010316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:47.047417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:47.047854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:47.048141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:47.048423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:47.049614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:47.051182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:47.052808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 25/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:47.058703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:47.074878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:47.128319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec533bfa-70b0-454b-947e-693c2bf194c6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:47.150768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:47.168126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:47.168991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:47.169169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:47.169319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:47.170475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:47.171939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:47.172675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09639-3209-4e5f-a9a2-9956c1129645 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:47.173795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 30/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:47.180021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:47.210828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:47.211467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:47.211755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:47.212037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:47.212708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:47.214344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dbee2-056a-4821-865c-957a8ff6ca79 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:47.246532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 26/56] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Sep 21 09:50:47 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:50:47.420695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b6a1-45e3-4249-bf3a-b25ea14dfd6a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:47.447211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:47.460648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:47.461265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:47.461548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:47.461823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:47.462592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.domain.id=default, user.id=9984ac48f53d4200ac584a0c0d9f52b9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:47.462905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:47.464373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2078c60-d1f8-441a-99ab-83cf9e48d99d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:47.473324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 31/57] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Sep 21 09:50:47 2022] GET /identity/v3/role_assignments?user.id=9984ac48f53d4200ac584a0c0d9f52b9&scope.domain.id=default&role.id=501008bc08bd430ea940373b81e53c53 => generated 530 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:49.482079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e871-e9a3-4b81-a435-1322e6c0cc25 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:49.482638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e871-e9a3-4b81-a435-1322e6c0cc25 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:49.482720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e871-e9a3-4b81-a435-1322e6c0cc25 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:49.483992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 27/58] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:49.489218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:49.489583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:49.489785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:49.507619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:49.508818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:49.573930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:49.844296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3e871-e9a3-4b81-a435-1322e6c0cc25 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:49.943511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3e871-e9a3-4b81-a435-1322e6c0cc25 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:49.977703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:49.978354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:49.978643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:49.978917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:49.980021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:49.981459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d15b24-1227-4eff-8370-a31bcc935b68 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:49.983042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 28/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:49.988634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:50.083628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc734492-1a27-46fd-a508-861e0f204a40 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:50.100299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:50.117849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:50.118485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:50.118769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:50.119042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:50.119687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:50.121124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5f9dd-d86c-4674-907a-279dc8fea0a6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:50.147851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 33/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:50:49 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:53.973078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cc27-322f-4a67-b003-8671dbadf3a7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:53.974668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cc27-322f-4a67-b003-8671dbadf3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:53.976017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cc27-322f-4a67-b003-8671dbadf3a7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:53.984062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 29/62] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:53.989837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354ecb-76bb-40ef-bac9-52e03408fd27 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:53.990578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354ecb-76bb-40ef-bac9-52e03408fd27 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:53.990578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354ecb-76bb-40ef-bac9-52e03408fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.019887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-16354ecb-76bb-40ef-bac9-52e03408fd27 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:54.022912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-16354ecb-76bb-40ef-bac9-52e03408fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:54.069852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21754-fdef-45ad-ad13-dfd35aed3905 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.070844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21754-fdef-45ad-ad13-dfd35aed3905 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.071648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21754-fdef-45ad-ad13-dfd35aed3905 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.074503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 30/63] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:54.080927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352e6-8995-4293-aad2-d8b128b1e8cd None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.081783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352e6-8995-4293-aad2-d8b128b1e8cd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.082547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352e6-8995-4293-aad2-d8b128b1e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.122823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:54.139266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6a4352e6-8995-4293-aad2-d8b128b1e8cd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:54.141256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6a4352e6-8995-4293-aad2-d8b128b1e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:54.222163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:50:54.307734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:54.605335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef28c-c428-4525-b7d3-3caa118400ad None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.605775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef28c-c428-4525-b7d3-3caa118400ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.606273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef28c-c428-4525-b7d3-3caa118400ad None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.609347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 35/66] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:54.618092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.618596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.619056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.620779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef28c-c428-4525-b7d3-3caa118400ad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:54.683913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:54.691491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:54.824188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:54.825068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:54.902311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef28c-c428-4525-b7d3-3caa118400ad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:54.905277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:54.906121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:54.941900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190794e-792b-4d0e-95a5-61278ccb203f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:54.982293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:54.982544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:54.983155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.983495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.983655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.984960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:54.985733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:54.986536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:54.996318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b7ed6a55-60c2-4a7d-8553-e93e34cbde55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:55.001443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:55.003191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:50:55.004787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:50:55.008139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:55.010107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726e7e-b8f7-4a95-8e6c-b0c5596ce97f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.010457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726e7e-b8f7-4a95-8e6c-b0c5596ce97f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.010701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726e7e-b8f7-4a95-8e6c-b0c5596ce97f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.012081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 34/69] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:55.014295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726e7e-b8f7-4a95-8e6c-b0c5596ce97f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.020880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3d942ccc-1014-43b1-aca8-d59e5f3ae559 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:55.026685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:55.028414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:50:55.029957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:50:55.033144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:55.035221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.035527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.035772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.058386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:55.059626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:55.198598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:55.198598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.217859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726e7e-b8f7-4a95-8e6c-b0c5596ce97f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.278998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:55.298305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.298929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.300732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.300732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.300732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:55.300732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:55.302026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:55.314643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:55.320813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.400538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:55.417641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a3d5-06aa-4628-a4d5-8f5174dc4d20 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.470951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed8b52-d93f-4927-aaa6-78f1c650984c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.482061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.483117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.483606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.484091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.485272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:55.485816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:55.488445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:55.512072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:55.513865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.529763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.530562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.530843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.531118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.532351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:55.533836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eace3-31eb-4ca7-96b2-e19d100b4fd0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:55.535746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:55.541215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ed42-d7a4-4a13-ad42-42d71437dfc6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.542360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ed42-d7a4-4a13-ad42-42d71437dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.543188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ed42-d7a4-4a13-ad42-42d71437dfc6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.547547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 37/75] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:50:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:50:55.554554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ed42-d7a4-4a13-ad42-42d71437dfc6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.653404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4e70-2aa6-4c8f-b7a5-61142aaa3602 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.665973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:55.695216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.695885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.696169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.696448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.720516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:55.731508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:55.732562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:50:55.733313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:50:55.734169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:55.735038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.736416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ed42-d7a4-4a13-ad42-42d71437dfc6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.762325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:55.784089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.785144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.785628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.786133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.809494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:55.811041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56474b65-7edc-4270-8fbd-70b7412d1d5d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:55.812803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:55.814034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.814414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.814648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:55.833775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:50:55.835627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:50:55.898481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27204-48f5-4a09-98bd-cff1820dc46d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:55.922177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:50:55.922177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:55.947304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:55.948385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:55.949036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:55.949658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.007610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.066037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.068690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.097413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.104340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a26b8c-9131-45ea-98cf-a1d8022a3ca8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.161049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.163229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.163701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.164297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.181357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:50:56.190100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:50:56.191222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:50:56.192139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:50:56.193213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.234819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:50:56.235715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.329099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6511-66e7-450d-8c77-ac6d44c71c14 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.331567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.371267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.372166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.372630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.373154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.374270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:56.374821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.376435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bcf18-5b90-4bae-903d-911157410aae None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.377569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.391416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:56.391871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.392988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.426485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.427520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.427988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.428854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.514269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b70e-b28e-4bb7-9b47-bd91db214d62 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.522522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.524184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.549833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.550522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.550832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.550832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.552257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.554303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.556142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 42/82] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:56.557397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.599602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.654090 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:50:56.655030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.672404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.685156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ef0-0715-47b1-843d-ba6aab2f8c66 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.728957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.729584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.729866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.730143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.730860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:56.731171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.732577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.742920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 43/84] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:56.749821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.802137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407a12-8d67-4481-ab76-d7bbd2aa82b1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.847472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.848109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.848391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.848661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.849867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.851805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.855662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 42/85] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:56.855662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.857248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.862027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411f9f-9c65-47e5-9876-ca2c56ea7150 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:56.901582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:56.902271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:56.902573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:56.902854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:56.904062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:56.905556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:56.907269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:56.908055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:56.957999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:56.978416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20812d86-bbb8-43c3-8b82-604027d2fc8e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.013671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.014314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.014599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.014883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.015537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.017100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.027797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c690-6a43-4c16-a67d-f9cee35e8b77 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.041852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 43/87] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:50:56 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:50:57.042730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.088937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.090063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.090507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.090936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.092907 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.095049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.103952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 45/88] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:50:56 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:57.103952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.164595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:57.191246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60734c-9778-4f86-ba47-4ce1b29e8051 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.238143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.240320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.240831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.241251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.242902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.244682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.246779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:57.248731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.267761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:57.287068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088b6e-3514-4e2a-b96a-cfbaadcfd940 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.335801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.336444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.336750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.337066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.337826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=9984ac48f53d4200ac584a0c0d9f52b9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:57.338265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.339806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.349065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/role_assignments?user.id=9984ac48f53d4200ac584a0c0d9f52b9&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:57.350847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.461132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969469d-5aba-4c3f-a315-d94bf2a467b4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.536351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.537425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.538298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.538572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.574319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:57.582685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d985b4-6e74-44fa-9922-6ad1ca6d29b6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:57.657462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:57.659374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:57.660217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:57.660984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:57.664341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:57.664911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.667715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.670817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:57.674328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:57.675214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:50:57.676705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.695762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:57.893359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:50:57.900551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:57.967650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761406d4-efd6-4278-9ea3-f63eca89e1bb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:58.064500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:58.065221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:58.065443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:58.065667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:58.159691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:58.171545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47dd9c-f5df-4d79-9763-5c53c848e099 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:58.190824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:58.279548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:58.281048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:58.281496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:58.282183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:58.282723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:58.283238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] PATH_INFO: `/v3/projects/c23a1cc4abf249b08492f230beae19dc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:58.289079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] RBAC: Authorizing `identity:get_project(project_id=c23a1cc4abf249b08492f230beae19dc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:58.291923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:58.295377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/projects/c23a1cc4abf249b08492f230beae19dc => generated 312 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:58.302320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:58.525822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215d1c-76f4-4550-b2eb-c70638c72592 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:58.587886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:50:58.595000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:58.600122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:58.600772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:58.601056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:58.601336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:58.602102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=c23a1cc4abf249b08492f230beae19dc, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:58.602442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:58.603941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:58.627312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:50:58 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=c23a1cc4abf249b08492f230beae19dc&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:58.728226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:58.823836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb51ab9-6265-46ad-b026-1cde25460c57 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:58.887682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:58.888684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:58.902662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:58.902662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:58.902662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:58.902662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5221dae-0fcc-4fe3-b61e-50a3e85833c9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:58.902662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:50:58 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:50:58.905039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:50:58.962133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:50:59.051132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108f17c-2054-4bb9-be97-6171529c420f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:50:59.102815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:50:59.103357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:50:59.103627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:50:59.103907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:50:59.104672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:50:59.104987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:50:59.106545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878164-d246-423e-b7c2-6c36032fa3df None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:50:59.115452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:50:58 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:00.661566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63641-cfb2-4d53-b389-fee456990579 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:00.662299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63641-cfb2-4d53-b389-fee456990579 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:00.662299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63641-cfb2-4d53-b389-fee456990579 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:00.663581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:00.680500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1978cc-d0b4-461d-a652-120ace8db061 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:00.681111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1978cc-d0b4-461d-a652-120ace8db061 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:00.681111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1978cc-d0b4-461d-a652-120ace8db061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:00.707445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1e1978cc-d0b4-461d-a652-120ace8db061 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:00.710283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1e1978cc-d0b4-461d-a652-120ace8db061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:00.809992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:00.889134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535490a3-4d1c-4228-935e-7a3fbfe5dabc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:00.889454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535490a3-4d1c-4228-935e-7a3fbfe5dabc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:00.889769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535490a3-4d1c-4228-935e-7a3fbfe5dabc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:00.891188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:00.897692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c074-8cd1-4f33-9d9c-25ec8f4abf4e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:00.897988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c074-8cd1-4f33-9d9c-25ec8f4abf4e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:00.898270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c074-8cd1-4f33-9d9c-25ec8f4abf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:00.927463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9cc2c074-8cd1-4f33-9d9c-25ec8f4abf4e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:00.928669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9cc2c074-8cd1-4f33-9d9c-25ec8f4abf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:00.961924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:01.027751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:01.093825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8993f4-7a71-4a0b-861a-ecdc256744d3 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.094143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8993f4-7a71-4a0b-861a-ecdc256744d3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.094467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8993f4-7a71-4a0b-861a-ecdc256744d3 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.095840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 52/102] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:01.101522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.101823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.102107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.125383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:01.126639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:01.176773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911d430-acb8-49f5-a622-60d3e9e882df None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.177087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911d430-acb8-49f5-a622-60d3e9e882df None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.177328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911d430-acb8-49f5-a622-60d3e9e882df None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.178890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 53/103] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:01.184596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090042ae-7788-4022-804e-87925b8de87d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.184861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090042ae-7788-4022-804e-87925b8de87d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.185219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090042ae-7788-4022-804e-87925b8de87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.212112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-090042ae-7788-4022-804e-87925b8de87d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:01.213404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-090042ae-7788-4022-804e-87925b8de87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:01.255921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:01.304911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.340838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 54/105] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:01.422499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:01.432965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ba89-66b0-423e-8714-e82f77bea185 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:01.470001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:01.470738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.471196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.471543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.483626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:01.488515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090042ae-7788-4022-804e-87925b8de87d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:01.490510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:01.492499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:01.494397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:01.507508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.642615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:01.732990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090042ae-7788-4022-804e-87925b8de87d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:01.740245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ae7d-72a6-4775-9196-8caf3d3e0dbd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:01.778198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:01.778879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.779168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.779446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.780710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:01.782181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:01.784070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 55/107] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:01.784598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.795712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:01.796769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.797249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.797718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.798740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:01.799282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:01.801111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:01.812544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 53/108] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:01.813822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.834618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:01.907751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fb4e-1f79-4619-8936-0c863000cc04 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:01.945642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:01.948755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676041fc-be86-4927-abf7-df833fe503ef None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:01.957396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:01.958412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.958912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.959534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:01.972432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:01.978578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:01.979450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:01.980323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:01.987719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 56/109] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:01.987719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:01.994973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:01.995939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:01.996444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:01.996932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.011232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:02.019319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:02.020228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:02.020966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:02.028735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:02.028735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.132045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.133633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a68-e02d-4037-a3f5-635b684d7ec4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.164788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769190-079c-4de8-99da-b3b8206515cf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.182861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.183864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.184367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.184843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.185722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.187445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.207514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.209023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.210231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.210643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] PATH_INFO: `/v3/users/662fb655072142d6872d1d539c1419b7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.224014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 57/111] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:51:01 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:02.225832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.234122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] RBAC: Authorizing `identity:get_user(user_id=662fb655072142d6872d1d539c1419b7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.235749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.237750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/users/662fb655072142d6872d1d539c1419b7 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:02.239052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.295668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.386670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd1fa-f180-4c38-981c-e2e2804048eb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.398932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8a30-9eb8-4a66-9472-a441b7606f2f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.436679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.437882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.437882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.437882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.439304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:02.439304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.440395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434428c1-7a5f-412f-9869-4f51a4ccc745 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.443364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.449857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:02.452530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7075-e932-4b52-ac8f-fd787aed99bd None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.453039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7075-e932-4b52-ac8f-fd787aed99bd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.453556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7075-e932-4b52-ac8f-fd787aed99bd None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.455876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.456334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 59/114] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:02.457159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.457470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc7075-e932-4b52-ac8f-fd787aed99bd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.462415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.462923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.465484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:02.465973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.467747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.480642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 56/115] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:02.482035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.583635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.588845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc7075-e932-4b52-ac8f-fd787aed99bd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.612826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbc01e-e0a3-4509-8b10-8d1b29929e33 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.629496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.630131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.630450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.630736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.651439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.652095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.652380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.652657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.653836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.655373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b896acc-443d-4c30-aeeb-75ebebdf7fa5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.661452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:02.661452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.661452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.661452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.680016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:02.681277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:02.709113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.710964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961d6a-b963-449c-b9d9-b356cc467085 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.760670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.774091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:02.775264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.839654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:02.844163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 60/118] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:02.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7778c-b3f5-4622-91c5-ede025b7e4c7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.846001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7778c-b3f5-4622-91c5-ede025b7e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.846346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7778c-b3f5-4622-91c5-ede025b7e4c7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.847782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 61/119] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:02.849202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7778c-b3f5-4622-91c5-ede025b7e4c7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:02.940413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef61a-3ed3-4f79-9c2c-1d9a1ae9b68e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.971920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7778c-b3f5-4622-91c5-ede025b7e4c7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:02.982297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:02.983153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:02.983541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:02.983928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:02.985838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:02.987649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:02.989908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:02.991069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.013256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.014134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.014589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.015014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.016429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.018080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507257-b011-45ee-9f0c-0111e81d8bb2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.020298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:03.022583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.023062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.023517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.043875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:03.045392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:03.062415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.112367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.114912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fb7b-0fdf-4ecb-8b08-ebfc6c8d5fa2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.119974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:03.120683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.155842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.156499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.156784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.157063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.158528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.160777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.163290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:02 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:03.163920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.267910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b305c2-6b63-44ee-b884-6830a27e7171 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.290061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170d873-356b-4cfe-9cad-88ca64ba024c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.317166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.317852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.318452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.319304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.321347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.323388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.324952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.327282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:03 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:03.328937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.339171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.340419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.340705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.340986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/9984ac48f53d4200ac584a0c0d9f52b9/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.343871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, user_id=9984ac48f53d4200ac584a0c0d9f52b9, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.345999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.363155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:03 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/9984ac48f53d4200ac584a0c0d9f52b9/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:03.364367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.414706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.473584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd878d-414b-4763-99c2-77dfc8fff3fd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.515561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f60bd-b611-4aa6-8875-0aecffbbac21 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.559200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.561554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.563056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.564288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.568394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.569208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.569943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.570335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.571193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=662fb655072142d6872d1d539c1419b7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:03.571589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.573893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.586292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:03 2022] GET /identity/v3/role_assignments?user.id=662fb655072142d6872d1d539c1419b7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=262a976aac2f422e9475e3317ee586e1 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:03.586292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.597234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:03.610957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:03.612613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:03.614150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:03.617559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:03.698928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.851431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527acd-48d7-4613-a29a-2f0b22dd97a2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.857300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e3e2-2ecd-45de-8f65-704a1624cf70 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:03.902061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:03.922522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.923570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.924530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.925332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.926938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:03.928235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:03.928914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:03.930699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:03.936296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, user_id=ca2e6a162d0049e2a445e7c785b3f0d7, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:03.938109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:03.948746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:03.954702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:03.955694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:03.956509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:03.959074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 66/128] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:03.960939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.001843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 63/129] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:03 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:04.002786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.155642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382a02-1cc9-48b6-92e6-aa51ba6d12f0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:04.223906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:04.224561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:04.225371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:04.225766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:04.228433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:04.228764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:04.230334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:04.273382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 67/130] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:04.280594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.364343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0c848-fd16-4df2-acd8-45fdbc47404a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:04.402659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:04.439985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:04.473267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:04.474556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:04.475588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:04.476018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:04.477226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:04.477708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:04.481331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:04.511821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:04.557596 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.599971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6797ea1-4c05-48e5-87a5-344971c76ddb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:04.675863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:04.676983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:04.677475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:04.678512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:04.683091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:04.684937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:04.686919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:04 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:04.693010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.854155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097ed3-ce54-4003-80c9-fadfb9bcebcf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:04.955392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:04.956359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:04.956831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:04.957320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:04.959705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:04.967380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:04.971541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 65/133] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:04 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:04.981454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:04.988946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624d58-99b0-4d9b-a4a6-275dcf773516 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:05.049381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:05.105449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:05.123115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:05.123803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.124094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.124377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] PATH_INFO: `/v3/projects/c23a1cc4abf249b08492f230beae19dc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.125772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c23a1cc4abf249b08492f230beae19dc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:05.127322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:05.129108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 69/134] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:04 2022] GET /identity/v3/projects/c23a1cc4abf249b08492f230beae19dc => generated 312 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:05.140347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:05.235951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad94f-abb6-470d-8cda-f0d0c45482cf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:05.323956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:05.324617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.324903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.325177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.327049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:05.328537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:05.332950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 66/135] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:04 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:05.341708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:05.370319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65b63f-42c3-4038-bce0-dd214cd002d4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:05.445582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:05.446291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.446587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.446870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] PATH_INFO: `/v3/projects/c23a1cc4abf249b08492f230beae19dc/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.449922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] RBAC: Authorizing `identity:create_grant(project_id=c23a1cc4abf249b08492f230beae19dc, user_id=ca2e6a162d0049e2a445e7c785b3f0d7, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:05.451461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122bc4-ca09-44ab-bdea-e3267cc63172 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:05.482503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 70/136] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:05 2022] PUT /identity/v3/projects/c23a1cc4abf249b08492f230beae19dc/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:05.485159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385401-9bfd-4205-a59e-10c312986cc4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.485640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385401-9bfd-4205-a59e-10c312986cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.486199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385401-9bfd-4205-a59e-10c312986cc4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.489616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 71/137] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:05.500121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.500625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.501136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.533773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:05.535542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:05.638277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:05.643640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a9c-9414-4989-b096-cef1a6e8d1df None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:05.678580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:05.732788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 72/138] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:05.758653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:05.759696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:05.760194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:05.760664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:05.769575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, user_id=ca2e6a162d0049e2a445e7c785b3f0d7, role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:05.772398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:05.810985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 67/139] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:05 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/ca2e6a162d0049e2a445e7c785b3f0d7/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 09:51:06.479297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:06.676807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cfdec-fe45-44c0-b924-20bbf68fedb2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:06.768417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:06.769908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:06.770743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:06.771526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:06.773890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:06.776942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca56625-8a2d-49fa-aaef-1dff5437c774 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:06.780439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 73/140] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:06.789788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:07.048557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11a8a-dc9f-4b6d-89cf-93e5ecb4e11c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:07.076263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2acb9-e9d6-4eaf-8b50-850bb8e987c7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:07.077225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2acb9-e9d6-4eaf-8b50-850bb8e987c7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:07.077979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2acb9-e9d6-4eaf-8b50-850bb8e987c7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:07.081273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 74/141] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:07.099477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:07.100891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:07.101628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:07.150504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:07.152017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:07.152798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:07.153495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:07.154761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:07.162726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628c3e0-623c-4ec9-b481-eb895cfa04e3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:07.167964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:07.169923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:07.222765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 68/142] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:51:06 2022] POST /identity/v3/users => generated 283 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:07.226022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a789b0-9369-4fb1-a7a9-2586fc6a3afc None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:07.226841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a789b0-9369-4fb1-a7a9-2586fc6a3afc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:07.227592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a789b0-9369-4fb1-a7a9-2586fc6a3afc None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:07.236781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 69/143] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:07.244092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:07.244779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:07.245256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:07.280814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:07.282481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:07.284369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:07.349352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:07.411281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 75/144] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:07.481676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 70/145] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:07.879053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:07.964695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.108586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e7c7-ad6a-43a5-857e-1ce3048b3bab None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:08.110742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98d03-036e-4618-b3ad-fed627eae4b5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:08.167248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:08.167928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.168212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.168492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.189328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:08.197456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:08.198567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.199069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.199577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c04f8204-8d5c-4685-b3f2-2ee8debb02da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:08.203114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:08.204123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:08.204924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:08.205545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 76/146] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:08.209308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543faf3e-13f5-4b86-b56c-6d2078804a11 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.209822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543faf3e-13f5-4b86-b56c-6d2078804a11 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.210314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543faf3e-13f5-4b86-b56c-6d2078804a11 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.213071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 77/147] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:08.224298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.225111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.226022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.227330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:08.232880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:08.234918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:08.236706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 71/148] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:08.239391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.263301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:08.275226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:08.276511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:08.312236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:08.405106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 78/149] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:08.408107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.431294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e71b24-bcda-4fd7-b4d3-c2bb0891ad01 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:08.480896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:08.481429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.481710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.481985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.482733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:08.483039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:08.484499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:08.500425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 72/150] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:08.515832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.693572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:08.731080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efcd4-5d16-4ada-8992-5cd0037f9754 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:08.781704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfdc85-737c-4589-90d9-3c150fa2aa02 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:08.831013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:08.831654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.832213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.832634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.833472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:08.833927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:08.835608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:08.868361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 79/151] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:08.881322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.883951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:08.884621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:08.884899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:08.885172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] PATH_INFO: `/v3/users/662fb655072142d6872d1d539c1419b7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:08.887119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] RBAC: Authorizing `identity:get_user(user_id=662fb655072142d6872d1d539c1419b7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:08.888839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:08.895391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 73/152] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:08 2022] GET /identity/v3/users/662fb655072142d6872d1d539c1419b7 => generated 289 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:08.905386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:08.954662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:09.100182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f843-35ef-40b5-9b4b-e99e0aae1b7b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:09.151543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:09.152756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:09.153383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:09.153928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] PATH_INFO: `/v3/users/9984ac48f53d4200ac584a0c0d9f52b9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:09.155433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=9984ac48f53d4200ac584a0c0d9f52b9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:09.157369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:09.161039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 80/153] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:08 2022] GET /identity/v3/users/9984ac48f53d4200ac584a0c0d9f52b9 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:09.162354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:09.189788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73eef-c445-460a-914d-620f711ca6aa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:09.290138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:09.291234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:09.291723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:09.292216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:09.297048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:09.299883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:09.303756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 74/154] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:08 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:09.305134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:09.359282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:09.368080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:09.373196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3437-a629-4f54-aa8d-fef4c6d8d2e6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:09.412798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:09.413830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:09.414364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:09.414843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:09.426978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:09.433729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:09.434785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:09.435632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:09.438007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 81/155] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:09.439045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:09.648634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6609e8-5ded-4613-8930-4017233e8151 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:09.675288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330662-a181-477e-9807-fa029c3639dc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:09.784601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:09.786376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:09.786779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:09.788696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/662fb655072142d6872d1d539c1419b7/roles/262a976aac2f422e9475e3317ee586e1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:09.793782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, user_id=662fb655072142d6872d1d539c1419b7, role_id=262a976aac2f422e9475e3317ee586e1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:09.796623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:09.815108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:09.816143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:09.816612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:09.817189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:09.835257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 82/156] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:09 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/users/662fb655072142d6872d1d539c1419b7/roles/262a976aac2f422e9475e3317ee586e1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:09.837057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:09.882831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:09.967923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:09.969906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:10.010942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:10.166213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec15d3a-2118-4fc4-956e-810e8997d51d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:10.238600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 75/157] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:10.247981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:10.302832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:10.303892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:10.304380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:10.304867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:10.306167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:10.306790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:10.309417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:10.338734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 83/158] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:10.349135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:10.402014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cbd8c-b7e5-4a94-9789-ea403f419067 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:10.422833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:10.451228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:10.452791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:10.453286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:10.453752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:10.455339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:10.457315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:10.459649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 76/159] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:10 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:10.469583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:10.619902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:10.664993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb116b34-18a3-4ec6-aebf-893dd2ff47eb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:10.704409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196685c-f18f-4d6b-9177-92dc44e89321 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:10.776180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:10.778555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:10.779467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:10.780226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:10.781923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=9984ac48f53d4200ac584a0c0d9f52b9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:10.782826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:10.786046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:10.806874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 77/160] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:10 2022] GET /identity/v3/role_assignments?user.id=9984ac48f53d4200ac584a0c0d9f52b9&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:10.807884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:10.808584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:10.808911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:10.809192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:10.810391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:10.811927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7120b-6819-4f29-ab4f-d65df63e2a7a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:10.813909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 84/161] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:10 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:10.820106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:10.970782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:11.019863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac64a0-6e1f-40c2-abd5-24fea03d839e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.020596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac64a0-6e1f-40c2-abd5-24fea03d839e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.020596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac64a0-6e1f-40c2-abd5-24fea03d839e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.022501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 85/162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:11.037521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb95d-c0dc-4b64-9e31-f549d98a42ee None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.037916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb95d-c0dc-4b64-9e31-f549d98a42ee None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.038066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb95d-c0dc-4b64-9e31-f549d98a42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.076585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dcfdb95d-c0dc-4b64-9e31-f549d98a42ee None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:11.077807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dcfdb95d-c0dc-4b64-9e31-f549d98a42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:11.084835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b91f2d-ba0c-4c6b-9991-3dc62652ab46 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:11.179619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:11.180806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.181307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.181777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.256723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 86/163] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:11.258094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e3c4-5efb-4263-aa77-fd63d8058fdb None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.258477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e3c4-5efb-4263-aa77-fd63d8058fdb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.258736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e3c4-5efb-4263-aa77-fd63d8058fdb None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.260085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 87/164] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:11.269264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.269661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.269834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.300298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:11.301555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:11.427118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:11.430640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:11.437185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 88/165] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:11.571544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:11.697353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 78/166] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 878 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:11.705559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:11.723362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:11.886745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d69cd-0b84-4718-ac42-7a1be4ef0f25 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:11.948063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:11.948728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:11.949002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:11.949266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:11.950440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:11.951920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:11.953914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 89/167] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:11 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:11.960435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.026976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.164143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:12.232627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77e31-5c4d-4bb8-b051-a9794467d82f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:12.295676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e880b6-f126-40e7-99b2-fc409b512bb6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:12.322009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:12.322009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:12.322009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:12.322009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:12.344485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:12.350807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:12.352644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:12.354185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 90/168] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:12.359014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.419765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:12.420286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:12.420562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:12.420837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:12.421586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:12.421890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:12.423375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:12.436807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 79/169] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:11 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 608 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:12.440172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.470682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:12.517981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce367-427f-4557-8dfb-79d061a5ad5a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:12.593621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:12.615723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:12.616691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:12.616980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:12.617276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:12.641057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:12.646293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:12.648056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:12.649555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 91/170] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:12.657069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.781061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7714b6-f4d6-4520-b51b-fa4ec516053a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:12.888525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:12.889551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:12.890027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:12.890518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:12.891759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:12.892308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:12.894960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:12.916055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 80/171] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:12.923511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:12.980190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103554ac-bb77-48e7-b5df-0c1b4cd5a884 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:13.087996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:13.089045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.089503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.089982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.091267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:13.091804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:13.094703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:13.113649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 92/172] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:13.120816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:13.150648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:13.183157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cadcc2-e0e5-48a2-8918-efd22bfcc219 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:13.262880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:13.263895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.264382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.264860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.267588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:13.270605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:13.274356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 81/173] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:12 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:13.290897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:13.291634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:13.397517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1106a2-ecbe-4f31-b6a9-815fb5957aa3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:13.480729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:13.481520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.481811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.482092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] PATH_INFO: `/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.483478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] RBAC: Authorizing `identity:get_user(user_id=ca2e6a162d0049e2a445e7c785b3f0d7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:13.485037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:13.486953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 93/174] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:13 2022] GET /identity/v3/users/ca2e6a162d0049e2a445e7c785b3f0d7 => generated 275 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:13.493284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:13.504722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db515e-32cb-4292-bcb0-72ca50dbb4e4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:13.558137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:13.558722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.559004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.559275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.583458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:13.723098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f3c6f-9f9d-470d-9bf3-2a9b0a1c2ebf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:13.728258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:13.730025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85e9c-4f82-4c31-9bae-4f1b34ed11e4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:13.775593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:13.779364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:13.780289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.780981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.782167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.934557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:13.936160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25816b7e-0091-4b0b-9c17-5940f45cf9cf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:13.952617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 82/175] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:13.954058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb4c-eda2-4738-ae97-95a380db7ca4 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:13.954369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb4c-eda2-4738-ae97-95a380db7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:13.954647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb4c-eda2-4738-ae97-95a380db7ca4 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:13.959306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 83/176] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:13.960236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ffb4c-eda2-4738-ae97-95a380db7ca4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:14.041375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:14.163785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 94/177] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:14.165803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d7f8-3fd1-4631-9ec5-1ce94779c8d9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.166331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d7f8-3fd1-4631-9ec5-1ce94779c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.166804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d7f8-3fd1-4631-9ec5-1ce94779c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.176381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ffb4c-eda2-4738-ae97-95a380db7ca4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:14.187510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0db0d7f8-3fd1-4631-9ec5-1ce94779c8d9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:14.188678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0db0d7f8-3fd1-4631-9ec5-1ce94779c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:14.204853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:14.243756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:14.244846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.245301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.245755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.247918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:14.250377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebccfbc-02c2-41c2-901e-27ed0b191993 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:14.253187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 84/178] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:13 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:14.255501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413becb-a74d-4a72-95ea-a5dcc38fcf3c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.256350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413becb-a74d-4a72-95ea-a5dcc38fcf3c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.256963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413becb-a74d-4a72-95ea-a5dcc38fcf3c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.262288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 85/179] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:14.267637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413becb-a74d-4a72-95ea-a5dcc38fcf3c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:14.274999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 95/180] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:14.276246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511c4a-97c0-43d5-bfaf-2374ff83f770 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.276606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511c4a-97c0-43d5-bfaf-2374ff83f770 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.276885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d511c4a-97c0-43d5-bfaf-2374ff83f770 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.282860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 96/181] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:14.282860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511c4a-97c0-43d5-bfaf-2374ff83f770 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:14.411722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413becb-a74d-4a72-95ea-a5dcc38fcf3c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:14.423348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:14.424101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d511c4a-97c0-43d5-bfaf-2374ff83f770 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:14.453939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:14.455085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.455386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.455788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] PATH_INFO: `/v3/projects/c23a1cc4abf249b08492f230beae19dc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.457226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] RBAC: Authorizing `identity:get_project(project_id=c23a1cc4abf249b08492f230beae19dc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:14.459345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e5dd-3f58-4f10-9b7a-bf511a3bb111 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:14.466268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 86/182] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:14 2022] GET /identity/v3/projects/c23a1cc4abf249b08492f230beae19dc => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:14.466268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807e1d5-a0a4-4834-9395-2e673d0df72e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.466268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807e1d5-a0a4-4834-9395-2e673d0df72e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.466268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807e1d5-a0a4-4834-9395-2e673d0df72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.469396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:14.470036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.470350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.470626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.471380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:14.471695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:14.473204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89516a76-c2c2-42f0-8c4d-7b7501f83f24 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:14.480252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 97/183] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:14 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:14.483896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40223-6fbb-4039-b3ed-659f2c6a1668 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.484631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40223-6fbb-4039-b3ed-659f2c6a1668 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.485115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40223-6fbb-4039-b3ed-659f2c6a1668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.485516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0807e1d5-a0a4-4834-9395-2e673d0df72e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:14.486847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0807e1d5-a0a4-4834-9395-2e673d0df72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:14.513450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fdf40223-6fbb-4039-b3ed-659f2c6a1668 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:14.516008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fdf40223-6fbb-4039-b3ed-659f2c6a1668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:14.533092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:14.581969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 87/184] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:14.583409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415eacd-67c6-4039-9d4c-45c3648801ae None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.583690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415eacd-67c6-4039-9d4c-45c3648801ae None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.584606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415eacd-67c6-4039-9d4c-45c3648801ae None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.590872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 88/185] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:14.590872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415eacd-67c6-4039-9d4c-45c3648801ae None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:14.623436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 98/186] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:14.624933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.625218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.625547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.648374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:14.649583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:14.740441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 99/187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:14.741741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415eacd-67c6-4039-9d4c-45c3648801ae None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:14.750799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:14.785827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:14.786492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:14.786777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:14.787103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:14.787872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=c23a1cc4abf249b08492f230beae19dc, user.id=ca2e6a162d0049e2a445e7c785b3f0d7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:14.788181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:14.789704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:14.796870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 89/188] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:14 2022] GET /identity/v3/role_assignments?user.id=ca2e6a162d0049e2a445e7c785b3f0d7&scope.project.id=c23a1cc4abf249b08492f230beae19dc&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:14.855646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.028197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:15.032862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.061134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760146d-8cd9-43aa-afaf-50fa0a301921 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.106805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.107460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.107741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.108015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.122460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:15.128437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:15.129550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:15.130479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 100/189] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:15.131199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.221569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c4cb-5ae2-455d-a498-2ea62fd3ead7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.263172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.264242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.264965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.265675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.266987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:15.268592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:15.270280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd553b5-cddd-4fcd-afac-1c0160d18acb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.270861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 90/190] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:15.272373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.312988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.314096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:15.314520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.314674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.314956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.317989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:15.329386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:15.334984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:15.335968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:15.336791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 101/191] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:15.337431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.384196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8c2b3-cbc1-4f6a-9b46-e119edf0f702 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.419722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.420328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.420599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.420863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.421535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:15.421837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:15.423245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:15.432116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 91/192] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:15.432971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.445462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650cfb-69a6-4100-b7c5-a22370bb4f16 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.483970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.484702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.485166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.485558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.486479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:15.488128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:15.531443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 102/193] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:51:15 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:15.531443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.563882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:15.567206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092fbb5-de68-4267-bec5-fbe73fa2ce03 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.602948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:15.633016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.634536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.635028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.636682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.655013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:15.660869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:15.666935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 92/194] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:15.667797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.712825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae696d-778c-447b-8ea1-62db6895c8f0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.776672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.777483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.777946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.778438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.779597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:15.780112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:15.782653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:15.797602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 103/195] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:15.799116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.815713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f4fb-2c5c-49a9-9fc0-834a4fdaf52c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:15.861302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:15.861953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:15.862264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:15.862552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:15.889938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:15.892403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:15.895346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 93/196] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:15.897567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:15.938691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.000152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238a72-ecb0-4b84-8306-0adad92a5694 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:16.021966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.060138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:16.060785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:16.061128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:16.061408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:16.062136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:16.062484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:16.063984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:16.077447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 104/197] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:16.081769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:16.123062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e0d8e-00f1-4356-b423-9a260f79d048 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:16.171307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:16.172156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:16.172313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:16.172600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:16.173742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:16.175262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:16.177295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 94/198] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:15 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:16.182633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:16.267067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e091f-bb93-40cc-9049-5f702d5cd215 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:16.288940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.308752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b179a5-aa66-44d1-93ae-8504b7638aaf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:16.335916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:16.336646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:16.336812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:16.336945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:16.365657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:16.366458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:16.366667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:16.366976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] PATH_INFO: `/v3/users/662fb655072142d6872d1d539c1419b7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:16.368241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] RBAC: Authorizing `identity:get_user(user_id=662fb655072142d6872d1d539c1419b7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:16.369708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:16.371392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 95/199] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:16 2022] GET /identity/v3/users/662fb655072142d6872d1d539c1419b7 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:16.372254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:16.437959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.497389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:16.501120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:16.591222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac488b6-9d08-458b-ab0f-2c9fe0e29a9e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:16.673458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:16.674577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:16.675065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:16.675550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:16.742857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.760607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 105/200] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:16.760607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:16.857320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:16.860585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:16.920804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:16.973095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611701e1-55bb-4ae3-ac9b-09af9981a9dc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.050774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.053711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.054421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.055541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.079424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 96/201] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:17.081148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:17.201601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:17.214228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.219243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.267046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa67f-02ea-4e12-b68e-76d65fb16a40 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.334802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:17.350599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.352201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.352882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.353605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.357091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.360349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.364743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 97/202] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:17.370724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:17.370724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:17.376049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:17.535682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2656f-3930-419c-b3c2-3a833ca0e882 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.546366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df5f4c-4633-43bc-bcb1-548a03314b98 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.588011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.588675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.589007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.589284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.590699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.592681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.596704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 107/204] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:17.596704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:17.606843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:17.639842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.641685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.643018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.644089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.645712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=d130566fa52e42c5bd0adb4d77bdc93a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:17.647200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.650104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.658559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:17.661500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 98/205] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/role_assignments?user.id=d130566fa52e42c5bd0adb4d77bdc93a&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:17.667313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:17.795052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0e86-307b-410a-9c08-9a5a68f21aa3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.880079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3adb0-05c5-4294-90c3-65c9cb8623c1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:17.922228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.923347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.923861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.924369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.926544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.929442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.931973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:17.932600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:17.932873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:17.933133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 108/206] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:17.933234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:17.933937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=d130566fa52e42c5bd0adb4d77bdc93a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:17.934268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:17.935872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9b3c6-d2a8-43ae-b018-4a3537ff23b2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:17.942651 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 99/207] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/role_assignments?user.id=d130566fa52e42c5bd0adb4d77bdc93a&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:17.943281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:18.164086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be148-da4b-47f8-864e-cf38a3e61f5f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:18.182268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:18.219017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:18.220062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:18.220598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:18.221076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:18.222056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, scope.project.id=b8ded58e90e944f48230c0a9627dad94, user.id=662fb655072142d6872d1d539c1419b7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:18.222606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:18.224296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892722d-d5da-4be0-acb5-be84afdec8bc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:18.235448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 109/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:17 2022] GET /identity/v3/role_assignments?user.id=662fb655072142d6872d1d539c1419b7&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=262a976aac2f422e9475e3317ee586e1 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:18.533837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187aeb1-147a-4958-96ac-50691d13d2b9 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:18.534213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187aeb1-147a-4958-96ac-50691d13d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:18.534543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187aeb1-147a-4958-96ac-50691d13d2b9 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:18.537441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 100/209] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:18.546175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150058-c441-44ab-a528-220634176e61 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:18.547159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150058-c441-44ab-a528-220634176e61 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:18.547663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70150058-c441-44ab-a528-220634176e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:18.575393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-70150058-c441-44ab-a528-220634176e61 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:18.577005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-70150058-c441-44ab-a528-220634176e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:18.673353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:19.221115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187aeb1-147a-4958-96ac-50691d13d2b9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:19.254990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145300c-f300-4344-9e92-d3ab22043908 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.255977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145300c-f300-4344-9e92-d3ab22043908 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.256741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145300c-f300-4344-9e92-d3ab22043908 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:19.259592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 111/211] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:19.271119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.272089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.272835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:19.307030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:19.309653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:19.324715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:19.407688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 112/212] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:19.418826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187aeb1-147a-4958-96ac-50691d13d2b9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:19.480507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:19.481525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.482201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.483032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:19.503615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:19.515474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:19.517287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:19.518876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:19.523732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 101/213] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:19.535459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:19.575866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:19.661889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccd57-a6ad-4e03-b259-d1176d26d200 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:19.706099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:19.741334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:19.743446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.744480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.745187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:19.746934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:19.748941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:19.751859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:19.775425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 113/214] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:19.784677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:19.866111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170d5c-697c-4f9e-a02e-c5e5f4653f0b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:19.891235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:19.934022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:19.943826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77d64-f64b-45bb-ad0c-0207281f07e4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:19.957920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:19.960134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.960834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.961547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:19.964190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:19.967827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:19.971973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 102/215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:19.978968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:19.995023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:19.996208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:19.996838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:19.997462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] PATH_INFO: `/v3/users/85dd9eb19dcc43bb9723e889b633c2e0` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.025640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] RBAC: Authorizing `identity:get_user(user_id=85dd9eb19dcc43bb9723e889b633c2e0)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:20.028717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:20.032028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 114/216] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:19 2022] GET /identity/v3/users/85dd9eb19dcc43bb9723e889b633c2e0 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:20.038421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:20.171184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e5d7-2343-4b29-9865-9bbda7fb0413 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:20.194366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632494-d10a-4be8-88f9-ab4ab8835bb0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:20.254589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:20.255553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.256050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.256522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.272734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:20.278291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.278291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.278291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.278291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:20.279608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b909e6-9226-4e30-a51c-74ff05946af0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:20.320149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:20.325377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 103/217] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:51:19 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:20.404204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957810c-28b8-4a80-8046-8bf989823f36 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.404800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957810c-28b8-4a80-8046-8bf989823f36 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.405685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957810c-28b8-4a80-8046-8bf989823f36 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.408628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 104/218] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:20.415919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50b46-ef94-4576-a81e-d1e4210672f3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.416597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50b46-ef94-4576-a81e-d1e4210672f3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.417167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50b46-ef94-4576-a81e-d1e4210672f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.425164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:20.426993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:20.450084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-dfc50b46-ef94-4576-a81e-d1e4210672f3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:20.452775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dfc50b46-ef94-4576-a81e-d1e4210672f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:20.512689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:20.573120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 115/219] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:20.578721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:20.603279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 105/220] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:20.719486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:20.805837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44e2a3-cd4b-41c1-83bb-84768fd43b94 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:20.836809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d039d6a-e2ff-4303-9954-100bfb93e8bf None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.837311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d039d6a-e2ff-4303-9954-100bfb93e8bf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.837803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d039d6a-e2ff-4303-9954-100bfb93e8bf None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.840507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 106/221] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:20.848114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.848613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.849165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.874476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:20.875582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:20.876064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:20.876548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:20.878741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:20.882033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:20.884037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:20.885466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:20.887007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 116/222] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:20 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:20.897003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:20.983797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 107/223] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:20.985577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.130094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0fd1-2c00-4607-af2d-8aa2aeef2d8f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:21.143152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:21.153805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143df8d-9523-4dce-9dd1-2b50d87eac67 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:21.176488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:21.223855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:21.225143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:21.225646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:21.228859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:21.230840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=85dd9eb19dcc43bb9723e889b633c2e0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:21.231446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:21.234151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:21.239087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:21.239765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:21.240576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:21.240851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:21.250515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 117/224] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:20 2022] GET /identity/v3/role_assignments?user.id=85dd9eb19dcc43bb9723e889b633c2e0&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:21.271657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:21.276924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:21.279029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:21.280271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 108/225] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:21.288538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.470592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.538031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3190a-1bb6-4c6b-bce6-5e2c3e02f4cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:21.612516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:21.613525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:21.613525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:21.613792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:21.614417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:21.614721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:21.616698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:21.635919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 118/226] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:21.639936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.680771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1272-72b8-45b0-a9fa-91319ca30718 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:21.752903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:21.763428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:21.764125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:21.764405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:21.764676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:21.784150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:21.794305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:21.795946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:21.797428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 109/227] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:21.804358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.835543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:21.867387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce941c-2828-44d4-98f5-babd2967e0ff None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:21.953042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:21.953694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:21.953972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:21.954261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:21.955578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:21.958260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:21.961726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 119/228] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:21 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:21.965888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:21.986751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121d39-c694-4de3-b7ef-8632dc68290b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:22.061769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:22.062305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:22.062589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:22.062860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:22.063529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:22.063828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:22.065216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:22.085566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 110/229] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:22.108611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:22.188421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef718c-894b-43f6-9e3d-7b1f5e5589fe None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:22.206650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:22.230538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:22.231197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:22.231471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:22.231742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:22.233738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:22.238417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:22.242206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:21 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:22.246828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:22.274648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:22.325099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d7cd-f1a6-4a14-8ea8-4a38c88ebfc9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:22.410168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5dc0-99dc-45d4-bdf0-889326db7e55 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:22.444437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:22.445086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:22.445361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:22.445625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:22.451047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:22.452523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:22.454580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:22 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:22.467167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:22.484992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:22.486679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:22.487113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:22.487602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/d130566fa52e42c5bd0adb4d77bdc93a/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:22.491109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, user_id=d130566fa52e42c5bd0adb4d77bdc93a, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:22.494106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:22.528228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 121/232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:22 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/d130566fa52e42c5bd0adb4d77bdc93a/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:22.727599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6e54-2a59-4c84-8fb3-bad6bf66a154 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:22.795598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:22.796384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:22.796662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:22.796936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:22.798834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:22.800751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e77f0-42e2-42d9-87bd-9b5d06ce01a7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:22.803770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 112/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:22 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:22.811771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:22.934232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:23.042853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc4534-1211-41b7-a889-388445a410cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:23.105413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:23.106111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:23.106434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:23.106710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/d130566fa52e42c5bd0adb4d77bdc93a/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:23.108998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, user_id=d130566fa52e42c5bd0adb4d77bdc93a, role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:23.110530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36414ff0-5ea7-4ab7-81d8-ad5a2e1767f6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:23.140153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:22 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/d130566fa52e42c5bd0adb4d77bdc93a/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:23.677440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84b7a-3068-4361-b3b7-9c4d8ba28849 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:23.678315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84b7a-3068-4361-b3b7-9c4d8ba28849 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:23.678315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84b7a-3068-4361-b3b7-9c4d8ba28849 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:23.680776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:23.687902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9986b1-d29b-4494-bf21-d71f0aa7ce3a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:23.688296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9986b1-d29b-4494-bf21-d71f0aa7ce3a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:23.688522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9986b1-d29b-4494-bf21-d71f0aa7ce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:23.719506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2b9986b1-d29b-4494-bf21-d71f0aa7ce3a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:23.721861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2b9986b1-d29b-4494-bf21-d71f0aa7ce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:23.874886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:24.371680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e276-52ba-43fc-a003-85daa6e4b78a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:24.372446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e276-52ba-43fc-a003-85daa6e4b78a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:24.373167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e276-52ba-43fc-a003-85daa6e4b78a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:24.376375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 114/237] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:24.382791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a808-13ee-4594-a605-3fc49fce5848 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:24.383682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a808-13ee-4594-a605-3fc49fce5848 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:24.384433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a808-13ee-4594-a605-3fc49fce5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:24.417809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2fa5a808-13ee-4594-a605-3fc49fce5848 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:24.420388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2fa5a808-13ee-4594-a605-3fc49fce5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:24.487391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:24.509723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e276-52ba-43fc-a003-85daa6e4b78a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:24.550183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:24.551151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 124/238] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:24.697832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14201b6b-fc3d-472e-8770-80130b4bfe37 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:24.698209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14201b6b-fc3d-472e-8770-80130b4bfe37 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:24.698451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14201b6b-fc3d-472e-8770-80130b4bfe37 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:24.707232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e276-52ba-43fc-a003-85daa6e4b78a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:24.714515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 125/239] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:24 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:24.715925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:24.716207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:24.716478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:24.737681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:24.739070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:24.804196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:24.804862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:24.805140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:24.805414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:24.825524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:24.839246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:24.840220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:24.841011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 115/240] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:24.858923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:24.881644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 126/241] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:24.887861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.014723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.056829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.070024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecada6-51ae-4d59-8a2a-a422fafdf957 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.098642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b858a8-68f5-49c9-bfd1-0e2c362e8456 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.188324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.189308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.189725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.190142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.214522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.215609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.216041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.216500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.219877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:25.220430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.223418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.232570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:25.245101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:25.246069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:25.246918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:25.247528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 127/242] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:25.259096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.264419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 116/243] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:25.269712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.445794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9491b8-7e42-4881-9be2-b322f40cca51 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.451023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203731b-3543-491d-81fd-af7ae777c01a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.486767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.487398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.487684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.487965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.488659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:25.488966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.490481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.500450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 128/244] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:25.501151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.518224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.519035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.519320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.519941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.521973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.524085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.526598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 117/245] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:25.527317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.527558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.531865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.698192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b9864-5464-452f-9e0d-04209d7d2b16 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.725086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa19f-3373-4034-a620-8f67e959d685 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.748380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.749347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.749863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.750357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] PATH_INFO: `/v3/users/9d3b476ab5bb46a09508be35e6471e3d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.781120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.781757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3b476ab5bb46a09508be35e6471e3d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.782274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.782748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.783196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] PATH_INFO: `/v3/users/85dd9eb19dcc43bb9723e889b633c2e0` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.784531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.784708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] RBAC: Authorizing `identity:get_user(user_id=85dd9eb19dcc43bb9723e889b633c2e0)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.786760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6fa62-71c3-451c-b463-ea0941b2ed8d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.787665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 129/246] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/users/9d3b476ab5bb46a09508be35e6471e3d => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:25.788981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.789286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 118/247] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/users/85dd9eb19dcc43bb9723e889b633c2e0 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:25.790799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84ae9-3f87-4e4c-822b-0b66cdeb129c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.791305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84ae9-3f87-4e4c-822b-0b66cdeb129c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.791778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84ae9-3f87-4e4c-822b-0b66cdeb129c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.793536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 119/248] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:25.794482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c84ae9-3f87-4e4c-822b-0b66cdeb129c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:25.881282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.895014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:25.930865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4bd35-c7ef-43c1-93a7-2c20a6000fb0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.944252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c84ae9-3f87-4e4c-822b-0b66cdeb129c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:25.981291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.981910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.982216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.982606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.983174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.983756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:25.984398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:25.984644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42f9e4-9180-40f0-a4ee-26d6bf04245a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.984810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:25.984938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:25.986084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:25.987612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:25.994639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 120/249] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:25.994639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:26.022294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 130/250] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:51:25 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:26.022294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.022294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.022294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.038126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:26.039310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:26.119702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 131/251] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:26.122503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:26.138717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae313e-d3f4-4863-8878-e4b8c52f2258 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:26.188538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:26.188894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:26.190122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.190777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.191349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.204594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:26.250704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a74a-af8a-4fd0-8871-d326b8fca350 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:26.281259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:26.283795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:26.300692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:26.301449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.301803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.302152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/85dd9eb19dcc43bb9723e889b633c2e0/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.305688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, user_id=85dd9eb19dcc43bb9723e889b633c2e0, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:26.307294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766e5a-ea36-4bda-ab6c-4d9cadab94b1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:26.328351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 132/252] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:26 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/85dd9eb19dcc43bb9723e889b633c2e0/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:26.329795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb9f3-2ec9-4a3c-88e2-abb5ba27aaa8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.330153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb9f3-2ec9-4a3c-88e2-abb5ba27aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.330557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb9f3-2ec9-4a3c-88e2-abb5ba27aaa8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.332350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 133/253] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:26.338553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.338984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.339347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.361277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:26.366334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:26.458011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 121/254] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:26.459876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:26.494157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 134/255] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:26.495361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:26.529573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:26.577307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:26.672899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa356f-c55d-427c-80a6-ea80880d0ed3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:26.705427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131c94-3fba-4c0f-8af0-eae9be34facb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:26.763519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:26.764595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.765074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.765550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.795913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:26.798705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:26.799690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:26.800185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:26.800647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:26.802894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:26.805614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:26.806058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:26.807002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:26.807800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:26.810346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 135/256] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:26 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:26.812416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 122/257] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:26.827581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:26.829461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.062464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:27.068712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd90c5-3de0-49f5-b61c-0ce566d3cea5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:27.080647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68d772-d19f-4e50-8152-deef960b0e57 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:27.120391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:27.170281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:27.171286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:27.171767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:27.172252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:27.173607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=9d3b476ab5bb46a09508be35e6471e3d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:27.174144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:27.176856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:27.182670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:27.183737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:27.184230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:27.184711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:27.185913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:27.186464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:27.189041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:27.208146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 136/258] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:26 2022] GET /identity/v3/role_assignments?user.id=9d3b476ab5bb46a09508be35e6471e3d&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=262a976aac2f422e9475e3317ee586e1 => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:27.209497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.219554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 123/259] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:27.228434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.492900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615f9b1-09cd-4099-a142-8ae1d8d6569a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:27.579130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:27.579794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:27.580072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:27.580342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:27.590615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8da5f-5921-4d36-a273-ad29a7f7407c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:27.617573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:27.623690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:27.625466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:27.627519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 137/260] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:27.632255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.681392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:27.682044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:27.682349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:27.682618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:27.684952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:27.686466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:27.688131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 124/261] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:27 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:27.695266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.741491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:27.774657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:27.858639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf81b8-3984-4d26-b949-e2538c245a62 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:27.923911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:27.924545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:27.924819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:27.925090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:27.925928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:27.926233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:27.928292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:27.944769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 138/262] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:27.951350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:27.959560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5c82-4599-4dd0-aadd-655474309939 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:28.088593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:28.089122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:28.089408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:28.089686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:28.125749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc713d-a37e-4357-8137-c617d5ab7c55 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:28.138862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:28.226462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:28.228206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:28.229028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:28.229798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] PATH_INFO: `/v3/users/d130566fa52e42c5bd0adb4d77bdc93a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:28.240363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] RBAC: Authorizing `identity:get_user(user_id=d130566fa52e42c5bd0adb4d77bdc93a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:28.240612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:28.241994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:28.244149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:28.247786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 139/263] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:27 2022] GET /identity/v3/users/d130566fa52e42c5bd0adb4d77bdc93a => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:28.260462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:28.296869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:28.528556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 125/264] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:28.538123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:28.651781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068876-5111-47eb-9f18-a5183c6a16de None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:28.823367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:28.824282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:28.824773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:28.825263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:28.957405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:28.978198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ff30-56fd-4f25-8313-06f522f389fe None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:29.036175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:29.038282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:29.046639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:29.065364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:29.066512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.067004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.067471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.071929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:29.074777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:29.087143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 126/265] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:28 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:29.097767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:29.244522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 140/266] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 985 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:29.250398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:29.389690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:29.402352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588f47-2e40-418d-885a-2e8c49a08b12 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:29.450458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af664d58-1cf1-485b-853f-6a96dd5673c7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:29.524066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:29.524725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.524993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.525268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.527474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:29.528474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.529043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.529538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.530931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=d130566fa52e42c5bd0adb4d77bdc93a) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:29.531095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:29.531474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:29.532579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:29.534033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7025b1-067c-4ace-9cc4-bf57ffe5d7bd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:29.534358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 141/267] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:29 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:29.552516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 127/268] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:29 2022] GET /identity/v3/role_assignments?user.id=d130566fa52e42c5bd0adb4d77bdc93a&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:29.555018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:29.706878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a290604-7759-4a2b-ba6d-8fd377d3ed33 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:29.763175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:29.763825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.764106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.764381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.765137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=d130566fa52e42c5bd0adb4d77bdc93a) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:29.765447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:29.767002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d021-f272-41f5-8ca2-6d74530e078e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:29.774621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 142/269] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:29 2022] GET /identity/v3/role_assignments?user.id=d130566fa52e42c5bd0adb4d77bdc93a&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:29.888485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda25e-9249-461e-a483-caf576747af7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.889450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda25e-9249-461e-a483-caf576747af7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.890543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda25e-9249-461e-a483-caf576747af7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.895584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 128/270] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:29.902228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9328eb-d26f-4150-b2a4-4cfcbfccec4a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:29.902550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9328eb-d26f-4150-b2a4-4cfcbfccec4a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:29.902789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9328eb-d26f-4150-b2a4-4cfcbfccec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:29.911590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:29.931028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7c9328eb-d26f-4150-b2a4-4cfcbfccec4a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:29.932255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7c9328eb-d26f-4150-b2a4-4cfcbfccec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:30.028476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 143/271] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:30.371434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda25e-9249-461e-a483-caf576747af7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:30.404244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b599c-a42d-4e9d-9f61-61df06c77862 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:30.405031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b599c-a42d-4e9d-9f61-61df06c77862 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:30.405031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b599c-a42d-4e9d-9f61-61df06c77862 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:30.406558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 144/272] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:30.415861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:30.415861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:30.415861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:30.434440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:30.434687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:30.517350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 145/273] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:30.543389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:30.653123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda25e-9249-461e-a483-caf576747af7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:30.734941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:30.735994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:30.736487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:30.736977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:30.758720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:30.768822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:30.770600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:30.773915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 129/274] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:30.779503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:30.833945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:30.895598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:30.975055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9566b8-a00d-49be-b4db-f820b95cfcec None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.046283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.047352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.047876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.048298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.049444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:31.049956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:31.052461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:31.057774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8a9d-fc2c-4314-8236-a173b703a309 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.073922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 146/275] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:31.077513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.099408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:31.128021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.129464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.130035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.131036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.151940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3614a37e-555f-4742-b590-73912d9eb6c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:31.164253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:31.165414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:31.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 130/276] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:31.168118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c055ba-3357-4312-abce-6944a9bf18df None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.168580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c055ba-3357-4312-abce-6944a9bf18df None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.169034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c055ba-3357-4312-abce-6944a9bf18df None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.175526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 131/277] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:31.175526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c055ba-3357-4312-abce-6944a9bf18df None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.266194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2ae24-9742-4eeb-913e-3c895d1a2a2b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.308177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:31.322787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.323581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.323934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.324260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] PATH_INFO: `/v3/users/867ff928638945dc87af682cc0f61cae` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.334711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c055ba-3357-4312-abce-6944a9bf18df None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.346214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] RBAC: Authorizing `identity:get_user(user_id=867ff928638945dc87af682cc0f61cae)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:31.349741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37112b-9460-4be1-b575-d5e444a9f03b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:31.351950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 147/278] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/users/867ff928638945dc87af682cc0f61cae => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:31.353899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.354265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.354536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.375363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:31.376645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:31.389439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.390531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.390981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.391397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.392227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:31.392672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:31.395106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:31.407232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 132/279] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:31.414910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.498021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 148/280] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:31.498021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.501411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:31.572970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01a3e-d8a8-4dc7-9372-b0d2b046c1fb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.614976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.615843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.616294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.616562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.617314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, user.id=867ff928638945dc87af682cc0f61cae, scope.system=all) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:31.617642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:31.619119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306ea6d-ddae-4ddc-9a9a-ce195ba12389 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:31.624042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b5645-bf81-4d4e-a17e-496df8658d69 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.624888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 133/281] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/role_assignments?user.id=867ff928638945dc87af682cc0f61cae&scope.system=all&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:31.626342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66f83-9b8a-4978-a8a9-ffef565d205e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.626628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66f83-9b8a-4978-a8a9-ffef565d205e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.626905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66f83-9b8a-4978-a8a9-ffef565d205e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.628383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 134/282] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:31.635674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.636058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.636225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.657974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:31.659061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:31.659301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:31.715969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.716648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.716926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.717452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] PATH_INFO: `/v3/users/85dd9eb19dcc43bb9723e889b633c2e0` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:31.719211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] RBAC: Authorizing `identity:get_user(user_id=85dd9eb19dcc43bb9723e889b633c2e0)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:31.720722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:31.722888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 149/283] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/users/85dd9eb19dcc43bb9723e889b633c2e0 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:31.732063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.791108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 135/284] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:31.791995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:31.839841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:31.925700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f1ba-985a-4564-b416-b9d3e9d4994f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.950044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212e77f-593b-4799-addf-a8b3ee09935b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:31.995641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:31.997076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:31.997830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:31.998578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.023384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.024534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.025001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.025528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.027734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.032883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.038305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 136/285] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:32.044104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.089569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:32.120017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.121911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.179487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14d6a-e6e1-42cf-8889-902739b43bfd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:32.182293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:32.219653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.220276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.220552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.220823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.221619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.223117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.258271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 137/286] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:51:32 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:32.258271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.310497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 150/287] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:32.319557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.461831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28602383-ddc2-4146-967c-d5b65367f5c6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:32.481715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:32.515099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c470-b09e-4258-8302-af615e3e4c3a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:32.520658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.522072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.522421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.522697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.541918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:32.556355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:32.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:32.558145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:32.558806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 138/288] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:32.567423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.581583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.586294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.586294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.586294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.586294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.588011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.590376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 151/289] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:32 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:32.601067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.604262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:32.784169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a3d7-bdd4-416d-81b0-1b9d0112c82e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:32.804763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb478ee9-2d8a-4d91-b012-fce82e6d1b19 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:32.868139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.869540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.870031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.870573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.871808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:32.872511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.875824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.884462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:32.886059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:32.886882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:32.887563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:32.891482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=85dd9eb19dcc43bb9723e889b633c2e0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:32.891766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 139/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:32.892707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:32.898288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:32.902078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:32.908161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 152/291] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:32 2022] GET /identity/v3/role_assignments?user.id=85dd9eb19dcc43bb9723e889b633c2e0&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:33.077335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:33.125498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474636f7-10aa-44b2-a56f-0d9e294f985a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:33.187519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:33.188180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:33.188461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:33.188737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] PATH_INFO: `/v3/users/9d3b476ab5bb46a09508be35e6471e3d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:33.189942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3b476ab5bb46a09508be35e6471e3d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:33.191478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:33.194132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 140/292] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:32 2022] GET /identity/v3/users/9d3b476ab5bb46a09508be35e6471e3d => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:33.202712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:33.250175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:33.415796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629dccb-ef24-49eb-9fcf-aa6d70b9cefc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:33.489612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:33.491196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:33.491686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:33.492171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:33.494187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:33.496955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a9f09-371d-4dfe-926a-cc442512e014 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:33.500371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 153/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:33 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:33.511392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:33.704079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb99b0-9e66-415b-8b0c-953937b47f64 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:33.767965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:33.769130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:33.769676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:33.770159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/9d3b476ab5bb46a09508be35e6471e3d/roles/262a976aac2f422e9475e3317ee586e1` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:33.774094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, user_id=9d3b476ab5bb46a09508be35e6471e3d, role_id=262a976aac2f422e9475e3317ee586e1)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:33.776743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df23137-d65d-4b68-9ca4-a6d91d9f9528 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:33.801743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 141/294] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:51:33 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/users/9d3b476ab5bb46a09508be35e6471e3d/roles/262a976aac2f422e9475e3317ee586e1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:34.441746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f613c-8dad-43a9-bcb2-e545f44884cd None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:34.442613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f613c-8dad-43a9-bcb2-e545f44884cd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:34.442613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f613c-8dad-43a9-bcb2-e545f44884cd None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:34.444416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 154/295] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:34.450045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:34.450518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:34.450893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:34.472957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:34.474835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:34.478555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:34.559392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 142/296] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:34.828497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f613c-8dad-43a9-bcb2-e545f44884cd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:34.925122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:34.948621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f613c-8dad-43a9-bcb2-e545f44884cd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:34.987489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:34.988043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:34.988312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:34.988589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.001636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:35.006804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:35.010749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:35.014759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 155/297] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:35.017709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:35.203118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e28993-a405-4c38-b4a6-068cc158b0de None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:35.266989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:35.268000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.268494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.268980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.270308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:35.271393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:35.274161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cdf23-1ba6-47e7-9c9d-289512a232c8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:35.292272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 143/298] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:35.298077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:35.404575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ac67-3c71-42f6-b54a-0fa7fed717e0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.404925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ac67-3c71-42f6-b54a-0fa7fed717e0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.405119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ac67-3c71-42f6-b54a-0fa7fed717e0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.406693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 144/299] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:35.413213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad432-4809-40df-a972-0730dc961eba None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.413544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad432-4809-40df-a972-0730dc961eba None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.413763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad432-4809-40df-a972-0730dc961eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.417898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc2bb-6b07-4b68-8606-66f25f739686 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:35.433960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-576ad432-4809-40df-a972-0730dc961eba None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:35.435385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-576ad432-4809-40df-a972-0730dc961eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:35.445161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:35.461590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:35.463011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.463516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.463994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] PATH_INFO: `/v3/users/867ff928638945dc87af682cc0f61cae` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.465531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] RBAC: Authorizing `identity:get_user(user_id=867ff928638945dc87af682cc0f61cae)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:35.467549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:35.469784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 156/300] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:35 2022] GET /identity/v3/users/867ff928638945dc87af682cc0f61cae => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:35.477083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:35.491228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:35.524407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 145/301] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:35.597010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615baf-51e5-447d-a25d-98c9d33a0f55 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:35.638050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:35.638777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.639064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.639345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] PATH_INFO: `/v3/system/users/867ff928638945dc87af682cc0f61cae/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.640919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=867ff928638945dc87af682cc0f61cae, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:35.642591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:35.659589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 157/302] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Sep 21 09:51:35 2022] PUT /identity/v3/system/users/867ff928638945dc87af682cc0f61cae/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 09:51:35.814945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ad432-4809-40df-a972-0730dc961eba None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:35.937272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ad432-4809-40df-a972-0730dc961eba None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:35.975035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:35.980867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:35.981834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:35.982453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:35.982896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:35.984296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:35.985910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637220fd-3770-47f3-a7b8-285f8a23a03e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:35.988055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 146/303] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:35.995150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:36.020203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421153c1-d9d1-4d2a-a34c-278f287d1108 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:36.020852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421153c1-d9d1-4d2a-a34c-278f287d1108 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:36.021303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421153c1-d9d1-4d2a-a34c-278f287d1108 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:36.023356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 147/304] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:36.029882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:36.030189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:36.030478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:36.049582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:36.050856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:36.099351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:36.139630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ac06-311c-46a9-85c5-52a85494f0aa None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:36.148499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 148/305] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:36.188682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:36.189629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:36.190191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:36.190849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] PATH_INFO: `/v3/groups` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:36.197351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:36.197351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:36.225888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 158/306] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Sep 21 09:51:35 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:36.442129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:36.595292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2fb42-a3a2-49c6-b229-08299f62c758 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:36.641126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:36.647840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:36.648770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:36.649204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:36.649626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:36.662941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:36.668324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:36.669449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:36.670472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:36.672757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 149/307] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:36.678922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:36.836377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6f6a-8a7d-4ab0-a557-3809b6cf7fb8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:36.878652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:36.879281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:36.879566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:36.879843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:36.880569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:36.880880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:36.882296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:36.883810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:36.893827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 159/308] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:36.903671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:37.054608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d143e-ca52-4563-91e2-6c85fd0c954b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:37.092867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:37.093526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:37.093808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:37.094084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] PATH_INFO: `/v3/users/3da069842ca048a8a323f0e3e064ec50` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:37.110659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] RBAC: Authorizing `identity:get_user(user_id=3da069842ca048a8a323f0e3e064ec50)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:37.112166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14751d-10af-4d20-b582-88a297f8bc40 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:37.114299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 150/309] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:36 2022] GET /identity/v3/users/3da069842ca048a8a323f0e3e064ec50 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:37.121079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:37.255847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabeb7-ee73-447d-b96c-99fd0b4bf0a2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:37.256498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabeb7-ee73-447d-b96c-99fd0b4bf0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:37.256982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabeb7-ee73-447d-b96c-99fd0b4bf0a2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:37.258881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 151/310] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:37.264718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764c21-161b-4951-816b-fd2b3640591f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:37.265337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764c21-161b-4951-816b-fd2b3640591f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:37.265873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764c21-161b-4951-816b-fd2b3640591f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:37.282298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3ab3b-31f5-428c-9c9f-d4452b2ae237 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:37.286415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-04764c21-161b-4951-816b-fd2b3640591f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:37.287996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-04764c21-161b-4951-816b-fd2b3640591f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:37.349838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:37.350748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:37.351200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:37.351650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:37.353238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, user.id=3da069842ca048a8a323f0e3e064ec50, scope.system=all) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:37.353451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:37.355144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:37.356411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:37.370138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 160/311] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 21 09:51:37 2022] GET /identity/v3/role_assignments?user.id=3da069842ca048a8a323f0e3e064ec50&scope.system=all&role.id=262a976aac2f422e9475e3317ee586e1 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:37.416830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 152/312] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:37.703094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:37.777735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:37.821691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c31-fc18-4397-89a9-43a6ae38446f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:37.861347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:37.862343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:37.862838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:37.863287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:37.875005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:37.880822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:37.881748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:37.882594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 161/313] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:37.893190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04764c21-161b-4951-816b-fd2b3640591f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:38.073739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04764c21-161b-4951-816b-fd2b3640591f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:38.138936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:38.139832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.140255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.140710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.141888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:38.142464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:38.145050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:38.167002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 153/314] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:38.171385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:38.366449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af270b5-7e67-4585-825f-3e4410496bce None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:38.404331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:38.432548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:38.433969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.434748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.435519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] PATH_INFO: `/v3/users/9d3b476ab5bb46a09508be35e6471e3d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.437728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3b476ab5bb46a09508be35e6471e3d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:38.440613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccbba8-f2e3-4705-b66f-3e92e6695414 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:38.444758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 162/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:38 2022] GET /identity/v3/users/9d3b476ab5bb46a09508be35e6471e3d => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:38.454369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:38.516955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:38.580454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01c7c-2019-4075-ae0d-71abdfc44ca8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.580863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01c7c-2019-4075-ae0d-71abdfc44ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.581209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01c7c-2019-4075-ae0d-71abdfc44ca8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.582881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 163/316] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:51:38.589748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38aba7-325c-4f61-902e-883ff8418c0f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.590044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38aba7-325c-4f61-902e-883ff8418c0f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.590328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38aba7-325c-4f61-902e-883ff8418c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.609897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0c38aba7-325c-4f61-902e-883ff8418c0f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:38.611153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0c38aba7-325c-4f61-902e-883ff8418c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:38.630193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c34a0-8cc1-471a-a1ed-6000b2a56847 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:38.680453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:38.681331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.681617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.682014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.731170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 164/317] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:38.828530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:38.832014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:38.892678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:38.940699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175fc0c-d446-487c-bc94-9602bc4be6f1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.941066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175fc0c-d446-487c-bc94-9602bc4be6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.941343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175fc0c-d446-487c-bc94-9602bc4be6f1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.943204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 165/318] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:38.950452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0909-a352-429f-b72c-1590756350c2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:38.951491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0909-a352-429f-b72c-1590756350c2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:38.952009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0909-a352-429f-b72c-1590756350c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:38.970968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 154/319] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:38.977200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:38.983913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-efea0909-a352-429f-b72c-1590756350c2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:38.985507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-efea0909-a352-429f-b72c-1590756350c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:39.114365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 166/320] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:39.114365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea0909-a352-429f-b72c-1590756350c2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.153892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2707d02-f2fd-4d05-be44-439072cdded9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.224744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:39.224991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.226633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.227339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.228559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.230956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:39.233723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:39.238499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 155/321] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:38 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:39.252491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.271194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:39.339362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea0909-a352-429f-b72c-1590756350c2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.414093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.415098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.415585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.416035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.431368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:39.444929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:39.446709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:39.448215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 167/322] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:39.456046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.473126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced93c5-d2fb-4ad0-966b-151a420714ce None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.540131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.541188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.541669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.542144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.543919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3, user.id=9d3b476ab5bb46a09508be35e6471e3d) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:39.544479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:39.547336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:39.558741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 156/323] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:51:39 2022] GET /identity/v3/role_assignments?user.id=9d3b476ab5bb46a09508be35e6471e3d&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=262a976aac2f422e9475e3317ee586e1 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:39.560146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.613610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ed54a-5fd1-4243-8f51-df2a0cb1ad43 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.635534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:39.679814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:39.693949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436206-2761-4470-b170-22e8051850e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.697446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436206-2761-4470-b170-22e8051850e0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.698513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436206-2761-4470-b170-22e8051850e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.699346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436206-2761-4470-b170-22e8051850e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.702196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436206-2761-4470-b170-22e8051850e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:39.705714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436206-2761-4470-b170-22e8051850e0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:39.709982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 168/324] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:39.727584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436206-2761-4470-b170-22e8051850e0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.768849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9359-e5c9-44fe-9a91-52759f72916a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.844295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.845570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.846040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.846766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.848550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:39.849500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:39.852106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0604e6c-5416-4493-bb96-d6411279fa47 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:39.870414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 157/325] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:39.871867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda76a9-577b-482c-8123-90402047d84e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.872160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda76a9-577b-482c-8123-90402047d84e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.872435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda76a9-577b-482c-8123-90402047d84e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.874010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 158/326] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:39.878904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda76a9-577b-482c-8123-90402047d84e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:39.918013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436206-2761-4470-b170-22e8051850e0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:39.970327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:39.970846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.971129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.971407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] PATH_INFO: `/v3/groups` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:39.972069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:39.973535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc854-584d-421d-bf4c-464899a4565e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:39.992750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 169/327] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Sep 21 09:51:39 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:51:39.994314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:39.994610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:39.994892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:40.021808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:40.023497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:40.058755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda76a9-577b-482c-8123-90402047d84e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:40.066388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:40.123063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:40.124661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:40.125088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:40.125834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] PATH_INFO: `/v3/users/867ff928638945dc87af682cc0f61cae` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:40.127831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] RBAC: Authorizing `identity:get_user(user_id=867ff928638945dc87af682cc0f61cae)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:40.130444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:40.138068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 159/328] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:39 2022] GET /identity/v3/users/867ff928638945dc87af682cc0f61cae => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:40.140784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:40.145074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:40.153186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 170/329] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:40.269053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0967-2b0f-43bd-9e51-53a08f22c0eb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:40.307721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:40.308348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:40.308638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:40.308930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:40.309636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] RBAC: Adding query filter params (role.id=67aa14b3cada47e5abb505ee855977d3, user.id=867ff928638945dc87af682cc0f61cae, scope.system=all) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:40.309947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:40.311452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:40.324916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 160/330] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 21 09:51:40 2022] GET /identity/v3/role_assignments?user.id=867ff928638945dc87af682cc0f61cae&scope.system=all&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:40.649145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:40.845120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85a753-bdc1-43e8-ae70-664f0aa2726f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:40.918317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:40.919252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:40.919713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:40.920266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:40.940584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:40.950599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:40.952376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:40.953969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 171/331] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:40.965289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:41.096386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:41.180342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6996b-04c3-4075-b347-f8f628dbdf7e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:41.258545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:41.260147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:41.260971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:41.261735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:41.263228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:41.266353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:41.269945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:41.287400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 161/332] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:41.297435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:41.362276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:41.511444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa6cb-13ff-49a0-b8d5-e8bef88ae5bf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:41.580289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:41.581770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:41.582648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:41.583962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] PATH_INFO: `/v3/users/3da069842ca048a8a323f0e3e064ec50` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:41.587911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] RBAC: Authorizing `identity:get_user(user_id=3da069842ca048a8a323f0e3e064ec50)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:41.590761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936525b-e57f-41e9-9992-8ac4c4cf120b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:41.594708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 172/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:41 2022] GET /identity/v3/users/3da069842ca048a8a323f0e3e064ec50 => generated 293 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:41.604039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:41.858741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c310d-515b-40d5-b13d-bb553833974d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:41.910906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:41.933159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:41.934303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:41.934777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:41.935256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] PATH_INFO: `/v3/system/users/3da069842ca048a8a323f0e3e064ec50/roles/262a976aac2f422e9475e3317ee586e1` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:41.938063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3da069842ca048a8a323f0e3e064ec50, role_id=262a976aac2f422e9475e3317ee586e1)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:41.940604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd72892-b139-4185-9172-864841ca76a6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:41.961401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 162/334] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Sep 21 09:51:41 2022] PUT /identity/v3/system/users/3da069842ca048a8a323f0e3e064ec50/roles/262a976aac2f422e9475e3317ee586e1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:43.194989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb9c5-18b7-428f-b0bf-08c9c21fa212 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:43.196125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb9c5-18b7-428f-b0bf-08c9c21fa212 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:43.196629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb9c5-18b7-428f-b0bf-08c9c21fa212 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:43.199917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 173/335] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:43.206594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389bef-fad3-46ee-adc4-60144f2bfb6b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:43.207745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389bef-fad3-46ee-adc4-60144f2bfb6b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:43.209041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389bef-fad3-46ee-adc4-60144f2bfb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:43.243562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8e389bef-fad3-46ee-adc4-60144f2bfb6b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:43.244813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8e389bef-fad3-46ee-adc4-60144f2bfb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:43.349665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:43.372582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5b96-c35d-4185-987b-00e1abc1fe45 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:43.373703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5b96-c35d-4185-987b-00e1abc1fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:43.374512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5b96-c35d-4185-987b-00e1abc1fe45 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:43.382414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 174/337] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:43.388749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:43.389301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:43.389715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:43.419928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:43.421420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:43.521400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 164/338] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:43.753559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca5b96-c35d-4185-987b-00e1abc1fe45 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:43.892829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:43.903244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca5b96-c35d-4185-987b-00e1abc1fe45 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:43.954121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:43.954814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:43.955096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:43.955368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:43.972255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:43.977588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:43.979323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:43.980819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 175/339] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:43.985870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:44.169357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:44.250815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:44.310873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f134c1-8cb5-4639-9443-d61cee579d73 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:44.409151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:44.409783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:44.410060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:44.410366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:44.411130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:44.411947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:44.413332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d91be-a350-445a-9d88-9b95c79a0cb0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:44.416765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec59f0-4aa9-447b-90d1-0c7bc12a4203 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:44.444941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 165/340] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:44.451522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b39d-3975-411c-921d-92a584444ae5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:44.452270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b39d-3975-411c-921d-92a584444ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:44.452928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b39d-3975-411c-921d-92a584444ae5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:44.455777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 166/341] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:44.457412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793b39d-3975-411c-921d-92a584444ae5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:44.472269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:44.472934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:44.473218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:44.473492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:44.499703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c1d75ce9-c922-40f8-a6a7-9b716b4e8cb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:44.509370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:44.511114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:44.512616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:44.519433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 176/342] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:44.521522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:44.521991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:44.522474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:44.578008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:44.581839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:44.617487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:44.668106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793b39d-3975-411c-921d-92a584444ae5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:44.678291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:44.744529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:44.745728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:44.762984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:44.763616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:44.763892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:44.764157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:44.883545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64953-51aa-459d-a296-1589c77b1299 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:44.951387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:44.952860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:45.018755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:45.019704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:45.020180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:45.020712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:45.021852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:45.026489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:45.029150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:45.057509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 178/344] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:45.066498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:45.075791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 167/345] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:45.082400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:45.087358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:45.099007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:45.308459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9e602-02e8-4039-8389-bcaa760e96ff None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:45.331777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ffe9-ba43-4010-9e97-e3c4f431f131 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:45.384205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:45.385640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:45.386386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:45.388310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:45.422548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:45.423091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:45.423364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:45.423632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:45.424932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:45.426459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:45.432033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 168/346] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:45 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:45.433020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:45.603471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:45.604862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:45.615125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:45.635666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:45.685391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b1a1-0e52-41dc-8e0d-20ea264c7ee6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:45.756361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:45.757563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:45.758052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:45.758568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:45.780119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:45.791368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:45.792373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:45.793267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:45.793883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 169/347] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:45.795490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:45.824680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 179/348] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:45.831314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:46.003660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c00-492d-412f-bff3-d7a3736eab49 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.064651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519c0f-dcd8-45de-9ca3-944d5447936e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.074631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.076486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.077589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.078342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.079629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.086853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.093546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.096434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.100012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 170/349] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:45 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:46.101363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:46.128018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.128649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.128935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.129188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.130430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:46.130743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.132179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bdec8-3268-4e6f-af62-09df7e6a717e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.142558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 180/350] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:46.144039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124da3d-4d58-4a7c-b05c-a503910b5b1a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.144208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124da3d-4d58-4a7c-b05c-a503910b5b1a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.144476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124da3d-4d58-4a7c-b05c-a503910b5b1a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.151142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 181/351] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:46.152645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124da3d-4d58-4a7c-b05c-a503910b5b1a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:46.288720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124da3d-4d58-4a7c-b05c-a503910b5b1a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.294220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bfbf9-3262-4c85-b8b2-27591f28cfcd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.330665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.331280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.331558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.331830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.332560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=b8ded58e90e944f48230c0a9627dad94) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:46.332970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.334921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5527-e06f-4071-a675-86c5d8c53ade None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.337960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.339185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.339627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.339893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.341159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.343039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.343690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 182/352] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:46 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:46.344830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 171/353] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:46 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:46.345478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:46.345884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627b37-9905-4246-ae33-f62c839ca1a4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.346366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627b37-9905-4246-ae33-f62c839ca1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.346911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627b37-9905-4246-ae33-f62c839ca1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.368722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3c627b37-9905-4246-ae33-f62c839ca1a4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:46.370474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3c627b37-9905-4246-ae33-f62c839ca1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:46.423477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.447337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.498049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 183/354] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:46.499914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5179-50b6-4158-8659-7a44588d0557 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.500257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5179-50b6-4158-8659-7a44588d0557 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.500602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5179-50b6-4158-8659-7a44588d0557 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.502203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 184/355] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:46.503188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb025-cc15-4f5d-8208-ad6dfa3f733f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.503590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb025-cc15-4f5d-8208-ad6dfa3f733f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.503930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb025-cc15-4f5d-8208-ad6dfa3f733f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.509979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 185/356] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:46.511003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb025-cc15-4f5d-8208-ad6dfa3f733f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:46.513492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7989da-4c6c-4d02-a49a-21ad4e3e7342 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.581047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.581861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.582281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.583825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.719214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.722808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64f890-8f65-42de-9a64-fdbf89d1c173 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.729536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb025-cc15-4f5d-8208-ad6dfa3f733f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:46.804214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:46.805734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.807200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.807932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.810787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:46.814436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9233f4-0b00-4280-bb19-7145834aa7db None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:46.819194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 186/357] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:46 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:46.827106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.828009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.829251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.860450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:46.862001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:46.865341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.912661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:46.920100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 172/358] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:46.921289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:46.921572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:46.921851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:46.941934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:46.944192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:46.997206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 187/359] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:46.998554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.062437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 173/360] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:47.071297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.169123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61d6a4-003a-4b52-acf2-f0be7133b9f7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.236022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.236768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.237102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.237386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.260731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:47.269123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:47.274860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291a40a-e502-4e3c-933c-057eb010d253 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:47.277902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:47.279583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 188/361] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:47.281946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.334782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:47.362145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.362903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.363063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.363408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.364095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=b8ded58e90e944f48230c0a9627dad94) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:47.364404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:47.367492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:47.376548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 174/362] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:47.377397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.499643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e554-526a-4d75-83b5-018a200fdaea None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.549527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.550187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.550517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.550811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.552115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:47.553747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:47.556457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 189/363] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:47.564691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.607817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2dc5e-4ab3-4281-9764-63871b7a07e0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.682123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.682906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.683195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.683473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.684175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:47.684482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:47.685904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:47.698040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 175/364] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:47.702779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.747283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:47.761306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:47.778854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf6c5-ab05-4cff-af59-bf6f50708995 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.831404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.832310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.833985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.834455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.835893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:47.838403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:47.841156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 190/365] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:47.843068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:47.867286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b6af-8111-43c4-a4ca-12f14331bda7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:47.930454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:47.931095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:47.931385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:47.931656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:47.948057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:47.954836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:47.956529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 176/366] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:47.958120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.075758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073626ec-75d6-4092-a1d6-281580b82a1e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.084410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.116002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6e79-b661-4939-86d3-47bdfa11ede4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.134600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.135494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.135810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.136486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.163966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.164694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.164971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.165238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.172204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.179505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:48.187352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:48.188462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:48.189346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 177/367] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:48.190018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.245719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.247988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.328635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291984-8897-4e6c-916e-d41a1cfcb13d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.373988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.375180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.375299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.375522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.376440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:48.376619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.378171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.386456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 178/368] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:48.387172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.412658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.431103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 191/369] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:48.432259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.578928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.642028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d663-579a-4f9d-99f0-5b0cb1303dcf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.681213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c071-a10e-473d-b39b-e8b461ccb95e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.688691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.689731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.690284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.690768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.691683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:48.692263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.694016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.705343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 192/370] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:48.707678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.735809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.736720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.737165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.737577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.738741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:48.739629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.742325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.753220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 179/371] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:48.754506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.838679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45ce4-10ce-485c-886f-f86f280d3520 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.848023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.862554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:48.885374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.886310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.886703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.887359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.888643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.890259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.890681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9fbf9-a599-40d1-aa72-f9ae4577830a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:48.892621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 193/372] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:48.894477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:48.955422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:48.957130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:48.957304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:48.957532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] PATH_INFO: `/v3/users/3da069842ca048a8a323f0e3e064ec50` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:48.963257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] RBAC: Authorizing `identity:get_user(user_id=3da069842ca048a8a323f0e3e064ec50)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:48.965373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:48.970283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 180/373] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/users/3da069842ca048a8a323f0e3e064ec50 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:48.972399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:49.111745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decac72-f051-4aa2-b50b-31a075520b9c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:49.182034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0087-f412-4349-9510-9a93812c6252 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:49.187606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:49.188735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.189242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.189745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:49.297552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:49.298657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.299126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.299594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:49.306043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:49.308703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:49.311971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 181/374] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:49.313212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:49.343065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:49.378688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:49.427629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:49.430183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:49.540505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61530-75ea-4edd-aecf-efef84f89bae None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:49.607401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:49.608374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.608814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.609482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:49.611339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] RBAC: Adding query filter params (role.id=262a976aac2f422e9475e3317ee586e1, user.id=3da069842ca048a8a323f0e3e064ec50, scope.system=all) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:49.611825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:49.616582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:49.641460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 182/375] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Sep 21 09:51:49 2022] GET /identity/v3/role_assignments?user.id=3da069842ca048a8a323f0e3e064ec50&scope.system=all&role.id=262a976aac2f422e9475e3317ee586e1 => generated 510 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:49.642850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:49.736501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 194/376] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:49.738275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:49.762124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:49.861730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361a9-ca39-474f-97de-9ba720ffcdf3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:49.946923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:49.947862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.949879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.950422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:49.951580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:49.954590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:49.958574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48db65c-0720-4d81-ac16-2326813f6260 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:49.972268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 183/377] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:49 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:49.974861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ecf-9605-4b3f-bba5-76711473f397 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.977827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ecf-9605-4b3f-bba5-76711473f397 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.978758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d4ecf-9605-4b3f-bba5-76711473f397 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:49.982805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 184/378] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:49.992628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:49.993799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:49.994778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:50.007537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:50.029997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:50.033952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:50.052242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf5ed-e5aa-49dc-91c1-f7e8a9ea756b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:50.126061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 185/379] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:50.132388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:50.133705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:50.134304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:50.134795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] PATH_INFO: `/v3/projects/55e542a5235d4f308d797e26281f9ea9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:50.137038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] RBAC: Authorizing `identity:get_project(project_id=55e542a5235d4f308d797e26281f9ea9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:50.141242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:50.145166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 195/380] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:49 2022] GET /identity/v3/projects/55e542a5235d4f308d797e26281f9ea9 => generated 344 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:50.151329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:50.242976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:50.297951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ecbf3-cf9c-4900-8417-139454541a4d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:50.346009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:50.346958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:50.347389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:50.347841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] PATH_INFO: `/v3/groups/fbc3f16eddbd49df928a54fd043a7712` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:50.354486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] RBAC: Authorizing `identity:get_group(group_id=fbc3f16eddbd49df928a54fd043a7712)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:50.356272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:50.358719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 186/381] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:50 2022] GET /identity/v3/groups/fbc3f16eddbd49df928a54fd043a7712 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:50.366056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:50.550569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:50.611705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fc72-c064-4a18-a161-b88984dcbb3e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:50.672228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:50.672871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:50.674758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:50.675056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:50.675819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] RBAC: Adding query filter params (group.id=fbc3f16eddbd49df928a54fd043a7712, role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=55e542a5235d4f308d797e26281f9ea9) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:50.676131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:50.680912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:50.695834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 196/382] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:50 2022] GET /identity/v3/role_assignments?group.id=fbc3f16eddbd49df928a54fd043a7712&scope.project.id=55e542a5235d4f308d797e26281f9ea9&role.id=501008bc08bd430ea940373b81e53c53 => generated 260 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:50.743401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110db9dd-9796-439e-a0cf-c60f489a7ab3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:50.774679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:50.788867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:50.789535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:50.789819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:50.790094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:50.804232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:50.809448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:50.810438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:50.811238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 187/383] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:50.817250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:50.843921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:50.982234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0f44-4cc5-4a88-9152-f8d95405019d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:51.099904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:51.100924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:51.101429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:51.101915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:51.103158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:51.103746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:51.118293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:51.136464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 197/384] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:51.148115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:51.382688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d04bc-c843-467a-aa12-86e53f987baa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:51.446985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:51.448047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:51.448514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:51.449085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:51.451366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:51.454379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52754bf7-d4ed-4bba-8503-e46e5c1db78c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:51.457836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 188/385] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:51 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:51.467382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:51.678029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:51.725594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8ed4-6d8a-4cec-8944-30e9ea76ed1e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:51.726112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8ed4-6d8a-4cec-8944-30e9ea76ed1e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:51.726600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8ed4-6d8a-4cec-8944-30e9ea76ed1e None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:51.734656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 189/386] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:51.741739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4d64-02c2-483e-8004-0d56c4c02a17 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:51.742086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4d64-02c2-483e-8004-0d56c4c02a17 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:51.742398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4d64-02c2-483e-8004-0d56c4c02a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:51.756398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7140d4-34dd-4daf-ab15-1a36b7171a05 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:51.818154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7e2d4d64-02c2-483e-8004-0d56c4c02a17 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:51.826341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e2d4d64-02c2-483e-8004-0d56c4c02a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:51.920589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:51.920589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:51.920589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:51.920589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:51.921712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:51.921712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:51.921712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 198/387] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:51 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:51.939414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:51.966769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:52.034675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 190/388] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:52.170324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296679b-ba64-44a7-88ee-a3f295425b6e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:52.260130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:52.261612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:52.262340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:52.263032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:52.273993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, group_id=0a017ca4d3d5449bb93d73488fbd4ccc, role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:52.277172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:52.291424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61477aa-3afc-491a-acd8-dc5fc68728da None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:52.292030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61477aa-3afc-491a-acd8-dc5fc68728da None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:52.292529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61477aa-3afc-491a-acd8-dc5fc68728da None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:52.294578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 191/389] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:52.308670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 199/390] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 21 09:51:51 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:52.312695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:52.313690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:52.314445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:52.368663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:52.371263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:52.410123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:52.435031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:52.493504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 192/391] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:52.651878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c295fc-6c1e-437b-af4a-5527c51fc068 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:52.733114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:52.733777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:52.734060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:52.734371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:52.746896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:52.752541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:52.754234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:52.756355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 200/392] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:52.763478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:52.911774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:52.916088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430ec09-56a9-46d5-98e3-3f19b5b116ad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:52.945220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:53.008928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.009582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.009882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.010265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.010993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:53.011298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:53.012745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:53.043518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 193/393] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:53.045170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:53.049836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:53.153199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540203f-ab72-43c9-abb2-12f53526d455 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:53.291206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.292250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.292720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.293181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.334841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:53.353892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:53.356124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:53.358107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 201/394] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:53.376326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ddfe7-d806-4132-8659-f84d1fea5e58 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:53.381440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:53.480018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.481375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.481856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.482363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.484659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:53.487608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1535c-feab-4cab-8a7d-24f27d89ef4b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:53.491977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 194/395] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:53 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:53.494429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7b8a-d514-4e52-a724-7a9bc8ad087d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.494894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7b8a-d514-4e52-a724-7a9bc8ad087d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.495380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7b8a-d514-4e52-a724-7a9bc8ad087d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.502412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 195/396] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:53.504006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7b8a-d514-4e52-a724-7a9bc8ad087d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:53.608001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:53.627098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d4dd-1378-4d44-bb64-66209c3fbf02 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:53.680054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:53.697860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.700337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.700337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.700999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.702559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:53.704707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:53.708776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77415-e609-4c41-ad0f-a4b6b7b549a3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:53.719604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7b8a-d514-4e52-a724-7a9bc8ad087d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:53.731841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 202/397] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:53.735192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.736183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.737616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.761751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.762803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.763298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.763761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.765573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:53.767421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:53.774524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 196/398] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:53 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:53.775665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:53.775875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:53.777898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:53.905235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761b73-cbcc-4520-aea9-e23d34c282ea None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:53.915883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:53.944868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 203/399] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:53.946010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:53.946549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:53.947396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:53.947902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:53.948360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:53.949705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:53.951465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:53.953588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 197/400] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:53 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:53.962418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:54.136062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c31bea-48d9-41d4-8f7a-3ec7bdc9cdb6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:54.178736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:54.200326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:54.201466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.202023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.202568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.206478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8ded58e90e944f48230c0a9627dad94, group_id=0a017ca4d3d5449bb93d73488fbd4ccc, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:54.209333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:54.214778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fde6-a8dc-4480-bd97-c671d6969818 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:54.244034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 204/401] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 21 09:51:53 2022] PUT /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:54.302419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:54.303553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.303983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.304404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.306604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:54.309540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:54.313224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 198/402] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:53 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:54.322820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:54.529096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7b127-dc55-4738-baef-56e9e40613d1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:54.529268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:54.605796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:54.607172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.607948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.608061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.611733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, group_id=0a017ca4d3d5449bb93d73488fbd4ccc, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:54.612244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:54.614828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8862e4-bd63-4f58-9199-2661300daf2e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:54.640019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 21 09:51:54 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:54.645854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ab5a-3796-466b-918a-1cc5cb13e671 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.646227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ab5a-3796-466b-918a-1cc5cb13e671 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.646511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ab5a-3796-466b-918a-1cc5cb13e671 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.649006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 206/404] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:54.663595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.663987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.664232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.691325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:54.691918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:54.759202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:54.788219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 207/405] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:54.790369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efed7b-2136-4dd5-8d63-264003ae8368 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:54.869234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:54.870404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:54.871004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:54.871482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:54.892968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:54.899847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:54.900829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:54.901654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:54.904335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 199/406] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:54.914341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.041007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd758b-562e-495e-b67f-4c435867e7fb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.082105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.082824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.083109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.083387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.084092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:55.084397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:55.085900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:55.096168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 208/407] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:55.103266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.171199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.238331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:55.263430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d10a-b7e2-41d4-8208-4e32476f5b42 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.267707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:55.332299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.334487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.335290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.336011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.338566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:55.342086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9d15-7d28-4a65-902f-b81e4dccf9c7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:55.346287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 200/408] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:55.348599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9e52-fc03-4dab-a5bf-02a769c0a8d9 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.349111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9e52-fc03-4dab-a5bf-02a769c0a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.349707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9e52-fc03-4dab-a5bf-02a769c0a8d9 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.351667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aa5db-1b47-449b-a4a1-1e10500de6ad None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.358477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 201/409] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:55.360294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9e52-fc03-4dab-a5bf-02a769c0a8d9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.393066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.393726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.394011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.394327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.407454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-74da6f0e-a7c1-4448-8d32-0d00839ac7e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:55.413143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:55.414127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:55.415575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 209/410] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:51:55.416279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.416279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.416396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.436112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:55.437357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:55.520917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 210/411] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:55.521788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.548058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:55.635929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9e52-fc03-4dab-a5bf-02a769c0a8d9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.644135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678bb62-8c38-4f42-8553-3c6a62b71489 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.682272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.683171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.683598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.684037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.684924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:55.685378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:55.686962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:55.696713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 211/412] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:55.706193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.751755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.752746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.753179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.753602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.755684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:55.757394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:55.759402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 202/413] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:55.779285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:55.814951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:55.838630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904732-b371-42f5-a34c-ed217da36892 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:55.883421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:55.884476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:55.885039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:55.885523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] PATH_INFO: `/v3/groups/fbc3f16eddbd49df928a54fd043a7712` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:55.891156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] RBAC: Authorizing `identity:get_group(group_id=fbc3f16eddbd49df928a54fd043a7712)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:55.894607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:55.896436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:55.903601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 212/414] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/groups/fbc3f16eddbd49df928a54fd043a7712 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:55.912606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:56.070278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a33d-760a-499b-bd93-4d8666ab87b6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:56.093563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2c9e-890e-4b26-a87b-d2513d478630 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:56.131633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:56.132282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:56.132563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:56.132841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] PATH_INFO: `/v3/projects/55e542a5235d4f308d797e26281f9ea9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:56.134009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] RBAC: Authorizing `identity:get_project(project_id=55e542a5235d4f308d797e26281f9ea9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:56.134440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:56.135514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:56.135626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:56.136082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:56.136579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:56.137193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 213/415] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:55 2022] GET /identity/v3/projects/55e542a5235d4f308d797e26281f9ea9 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:51:56.137994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:56.149046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=38a74b4e9ad440c38eebad138c6aa3d3, group_id=0a017ca4d3d5449bb93d73488fbd4ccc, role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:56.151779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:56.166125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:56.182291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 203/416] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 21 09:51:55 2022] PUT /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3/groups/0a017ca4d3d5449bb93d73488fbd4ccc/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:56.183701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:56.312743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338fbb-b078-4471-8fe6-c75ddc713cfd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:56.326792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:56.356828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:56.357625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:56.357912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:56.358186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] PATH_INFO: `/v3/projects/55e542a5235d4f308d797e26281f9ea9/groups/fbc3f16eddbd49df928a54fd043a7712/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:56.360205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=55e542a5235d4f308d797e26281f9ea9, group_id=fbc3f16eddbd49df928a54fd043a7712, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:56.361729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:56.401097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 204/417] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Sep 21 09:51:56 2022] PUT /identity/v3/projects/55e542a5235d4f308d797e26281f9ea9/groups/fbc3f16eddbd49df928a54fd043a7712/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:51:56.424493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f3d8-4b5e-4ac5-8a1f-a7a4dc64147d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:56.516090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:56.517122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:56.517632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:56.518104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:56.531900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:56.538004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:56.539025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:51:56.539805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:56.542645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 214/418] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:56.554286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:56.780176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6141da-2e5c-4d9b-9fc1-cb7fb37c61c3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:56.848473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:56.849595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:56.850111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:56.850690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:56.851670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:56.852281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:56.854022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:56.870530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 205/419] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:51:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:56.879222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:57.000703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:57.032623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3ce9-2f1b-4c57-98a3-fae8e72b18c1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:57.087013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:57.088023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:57.088512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:57.088984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:57.196584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:57.198569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:57.386954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:57.442274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 215/420] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:51:57.451344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:57.503821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:57.624695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64120b07-8e31-4f5e-b6d6-35ac1dc4a242 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:57.687489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:57.688654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:57.689149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:57.689625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:57.691163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:57.692934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82832fa4-30cb-4fb6-9a41-dc7dea12aa9d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:57.695310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 206/421] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:57 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:57.705307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:57.876213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c943-d78e-410a-9fc9-bc822a6d8dc3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:57.876884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c943-d78e-410a-9fc9-bc822a6d8dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:57.877358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c943-d78e-410a-9fc9-bc822a6d8dc3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:57.879292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 207/422] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:57.887930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0593-6827-493d-baf1-a97c6889804b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:57.888613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0593-6827-493d-baf1-a97c6889804b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:57.889119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0593-6827-493d-baf1-a97c6889804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:57.909830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d64a0-e46d-4789-9e40-33e5a4fde2a8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:57.916040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fe2b0593-6827-493d-baf1-a97c6889804b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:57.917266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fe2b0593-6827-493d-baf1-a97c6889804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:57.947671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:57.948260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:57.948544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:57.948821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:57.950051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:57.951651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:57.953682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 216/423] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:57 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:57.963530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:58.066420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 208/424] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:58.069352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0361-18d4-4af7-95e7-644ff2d160f0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.069853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0361-18d4-4af7-95e7-644ff2d160f0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.070360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0361-18d4-4af7-95e7-644ff2d160f0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.077110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:58.086662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 209/425] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:58 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:58.088097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.088391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.088671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.126316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:58.127992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:58.160879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:58.213571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44c38-099a-499f-8877-dd4bf8c66915 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:58.224534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 210/426] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:51:58.255335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:58.256239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.256666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.257079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.257958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=b8ded58e90e944f48230c0a9627dad94) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:58.258450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:58.260046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:58.267029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 217/427] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:51:57 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:58.388588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:58.531233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e55ea-fead-49d0-9e7f-d5838cf88806 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:58.595522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:58.597158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.597993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.598836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.614491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:58.618768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:58.631016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:58.631966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:58.632764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:51:58.635653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 211/428] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:58.643077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:58.674630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:58.768053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb242a-0fbb-48d6-b517-17df2ee953e3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:58.784097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:58.815316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:58.816233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.816756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.817280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.828920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e476-427c-467b-990d-d94bca4b89d1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:58.834631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:51:58.840739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:51:58.843072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:51:58.850278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 218/429] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:51:58.856030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:58.884062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:58.884706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:58.884989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:58.885267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:58.886543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:58.886855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:58.888636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:58.902374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 212/430] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:58.907197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:59.044341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be89f5-3380-412a-99d8-2d7421fa68d7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:59.069581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.096002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:59.096924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.097310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.097690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.099053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:51:59.099488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:59.101233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:59.112259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 219/431] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:59.118740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:59.132516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1551c-44b5-49a6-a6c5-21f9f68d40f0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:59.159489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.197984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:59.199551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.200308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.201066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.240376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633e320-6968-49b8-8075-82d82baf20cb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:59.279800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:59.280710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.281141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.281582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.338529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:59.341541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:59.360476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:59.362337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189923a5-a10b-419b-89f7-672a4cd62688 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:59.410320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.485411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.543816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 220/432] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 09:51:59.546420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caeae5-5e3e-49ec-80a7-a79e562f7bb8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.547285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caeae5-5e3e-49ec-80a7-a79e562f7bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.548071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caeae5-5e3e-49ec-80a7-a79e562f7bb8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.550419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 213/433] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 09:51:59.551437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:59.552402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 221/434] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:59.558294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.558584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.558838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.579997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:59.581277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:59.678013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 222/435] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:51:59.678013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:59.688175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99d423-1959-4dca-bf11-fa643195fdea None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:59.743331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:59.744233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.744578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.744927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] PATH_INFO: `/v3/projects/b8ded58e90e944f48230c0a9627dad94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.746433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] RBAC: Authorizing `identity:get_project(project_id=b8ded58e90e944f48230c0a9627dad94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:59.748079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b53e7-968b-4fbf-9bcb-4d985626a294 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:59.750367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 214/436] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:59 2022] GET /identity/v3/projects/b8ded58e90e944f48230c0a9627dad94 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:59.751502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f508-1081-4107-b1b9-6c0e72e86762 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.751858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f508-1081-4107-b1b9-6c0e72e86762 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.752196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f508-1081-4107-b1b9-6c0e72e86762 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.753969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 215/437] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:51:59.759597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f508-1081-4107-b1b9-6c0e72e86762 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:51:59.801449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.841815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:51:59.847811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f153605-8399-4572-8187-cd39f3c4a648 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:51:59.903274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:51:59.904753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.905503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.906294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.908666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:51:59.911652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a4bcc-a5c1-4d5f-b46f-59b8e0ebc170 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:51:59.915035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 223/438] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:51:59 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:51:59.917422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:51:59.917881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:51:59.918525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:51:59.951263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:51:59.953353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:51:59.962485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f508-1081-4107-b1b9-6c0e72e86762 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.003215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.003875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.004165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.004995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.006235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:00.007764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:00.009446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 216/439] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:51:59 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:00.009446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.078363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 224/440] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:00.078363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.146122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3bc6-b768-431b-ba4d-ea7a734520d2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.158511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:00.160364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:00.193767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.194610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.194893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.195169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.196500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:00.198055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:00.204969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 217/441] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:00.204969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.240132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7261e-e09b-4e6d-8ff2-c3960bc1438c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.304289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.305383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.305878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.306403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.323454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbfee-f8f4-4de8-8c9b-cfadb1d2c1db None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.325689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:00.336078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:00.337061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:52:00.337852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:00.338507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 225/442] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:00.339719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.370922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.371641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.371972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.372249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.373034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=b8ded58e90e944f48230c0a9627dad94) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:00.373351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:00.375196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:00.381775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 218/443] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=b8ded58e90e944f48230c0a9627dad94&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:00.382650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.453731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:00.534303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209df8-b8e2-4b8b-9b81-f5a83fe76eec None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.558260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae1d7-2f79-4599-874c-3c556548c71f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.589441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:00.599166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.600195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.600692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.601181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.602466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:00.603009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:00.605661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:00.606117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.606789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.607063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.607341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.608335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=67aa14b3cada47e5abb505ee855977d3, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:00.608660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:00.610639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:00.619643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 226/444] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=67aa14b3cada47e5abb505ee855977d3 => generated 611 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:00.620738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.623363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 219/445] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:00.630846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.815811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc8d69-7d0b-4016-95c5-8b9a0f6220b6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.828299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1514-928b-4e7e-8102-28e7bcb66ad3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:00.831303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:00.872676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.873757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.874279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.874759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.890237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:00.897503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:00.898534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:00.899385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 227/446] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:00.904107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:00.904322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:00.904657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:00.905155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:00.906674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:00.974001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.041433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.044247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.067578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2370d-198b-45d8-9d79-0a5033041b75 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.119531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.119890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.120302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.120774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.121945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:01.122507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.125053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.135889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 228/447] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:01.143157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.238323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 220/448] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:01.241986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.249517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.326995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d698-4186-4136-b2b9-3267d3a6d7cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.341130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.371977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.372605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.372887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.373160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.408904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820d4b5-4710-482d-8695-173e1c75060b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.466415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.467465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.467815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.468214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] PATH_INFO: `/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.469753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] RBAC: Authorizing `identity:get_project(project_id=38a74b4e9ad440c38eebad138c6aa3d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.471448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.473875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 221/449] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/projects/38a74b4e9ad440c38eebad138c6aa3d3 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:01.480211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.492078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.494431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.571244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.608795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd731-06d6-4a00-aa9d-ea6e8fa0956a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.620935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 229/450] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 09:52:01.626992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.637696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.652119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.653522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.654218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.654747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] PATH_INFO: `/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.656681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] RBAC: Authorizing `identity:get_group(group_id=0a017ca4d3d5449bb93d73488fbd4ccc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.659420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.667990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 222/451] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/groups/0a017ca4d3d5449bb93d73488fbd4ccc => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:01.669691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.740551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aea0b-755d-4b58-b5ea-194d1cedaa83 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.784195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.784924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.785326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.785772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] PATH_INFO: `/v3/projects/55e542a5235d4f308d797e26281f9ea9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.787196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] RBAC: Authorizing `identity:get_project(project_id=55e542a5235d4f308d797e26281f9ea9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.788928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.790939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 230/452] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/projects/55e542a5235d4f308d797e26281f9ea9 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:01.797205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:01.809548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b00054-9d89-4796-97db-21fec758b588 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:01.855412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:01.856260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:01.856622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:01.857049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:01.858345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] RBAC: Adding query filter params (group.id=0a017ca4d3d5449bb93d73488fbd4ccc, role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:01.858957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:01.860476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:01.868525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 223/453] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/role_assignments?group.id=0a017ca4d3d5449bb93d73488fbd4ccc&scope.project.id=38a74b4e9ad440c38eebad138c6aa3d3&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:01.916942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:01.959500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbbfa-cdd4-4a14-b90a-a761166f9760 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:02.020826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:02.021854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:02.022341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:02.022799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] PATH_INFO: `/v3/groups/fbc3f16eddbd49df928a54fd043a7712` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:02.024814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] RBAC: Authorizing `identity:get_group(group_id=fbc3f16eddbd49df928a54fd043a7712)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:02.027507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1fb1b-a97a-4867-b877-786d244604ef None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:02.030479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 231/454] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Sep 21 09:52:01 2022] GET /identity/v3/groups/fbc3f16eddbd49df928a54fd043a7712 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:02.038119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:02.042685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:02.177056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e21-8d9e-4bdf-bcae-19afcde09532 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:02.237849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:02.238998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:02.239520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:02.240005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:02.241372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] RBAC: Adding query filter params (group.id=fbc3f16eddbd49df928a54fd043a7712, role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=55e542a5235d4f308d797e26281f9ea9) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:02.241925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:02.244759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed1b4-4ee4-4ac9-81c4-4b9fc62a725a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:02.256384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 224/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Sep 21 09:52:02 2022] GET /identity/v3/role_assignments?group.id=fbc3f16eddbd49df928a54fd043a7712&scope.project.id=55e542a5235d4f308d797e26281f9ea9&role.id=501008bc08bd430ea940373b81e53c53 => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:05.158270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5c01-b8ae-4ea5-a8ad-dc57c95e23ad None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:05.158270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5c01-b8ae-4ea5-a8ad-dc57c95e23ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:05.158270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5c01-b8ae-4ea5-a8ad-dc57c95e23ad None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:05.159490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 232/456] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:05.165249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba96-0590-4827-ba37-827223637d29 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:05.166096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba96-0590-4827-ba37-827223637d29 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:05.166571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba96-0590-4827-ba37-827223637d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:05.194433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a95eba96-0590-4827-ba37-827223637d29 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:05.196075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a95eba96-0590-4827-ba37-827223637d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:05.274800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:05.283344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 225/457] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:05.440997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a262-be0b-4efa-9049-a838d5a11b83 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:05.441625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a262-be0b-4efa-9049-a838d5a11b83 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:05.442151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a262-be0b-4efa-9049-a838d5a11b83 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:05.444014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 233/458] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:05.450346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:05.450985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:05.451468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:05.477930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:05.479513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:05.584110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 226/459] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:05.683802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a262-be0b-4efa-9049-a838d5a11b83 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:05.834981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a262-be0b-4efa-9049-a838d5a11b83 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:05.882642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:05.884971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:05.890277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:05.890277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:05.890277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:05.912646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:05.914424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:05.933983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:05.935039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:05.935912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:05.935912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:05.935912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:05.935912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:05.943073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 234/460] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:05.944105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.074849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819faf3c-cbcf-42db-a587-a060aca5a83e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.111546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7415c81-2641-440f-b3ff-4a156031faee None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.115294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.115864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.116217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.116578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.117307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:06.117678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.119220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c614e0-dbaa-4686-ae9e-f78c59c3fa09 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.140364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 235/461] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:06.141712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601537-535d-44d7-b66e-47dd716f7251 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.142034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601537-535d-44d7-b66e-47dd716f7251 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.142404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601537-535d-44d7-b66e-47dd716f7251 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.149633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:06.149862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 236/462] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:06.151503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3eab8-3d7f-4606-b26e-103cbe9b73d9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.152362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3eab8-3d7f-4606-b26e-103cbe9b73d9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.152362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3eab8-3d7f-4606-b26e-103cbe9b73d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.164331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.165298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.165826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.166115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.173150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ebd3eab8-3d7f-4606-b26e-103cbe9b73d9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:06.174395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ebd3eab8-3d7f-4606-b26e-103cbe9b73d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:06.181761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.183262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:06.200385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:06.201343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:06.202307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:06.202307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:06.202307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:06.202307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 227/463] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:06.202525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.240634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 237/464] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770db9d-bce2-4f72-ad17-9fae5f7be8bc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770db9d-bce2-4f72-ad17-9fae5f7be8bc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770db9d-bce2-4f72-ad17-9fae5f7be8bc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 238/465] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:06.270417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770db9d-bce2-4f72-ad17-9fae5f7be8bc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.353449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db7aa-8119-4020-a693-02f32641d546 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.401228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.402303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.402839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.403319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.403984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.405482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee7639-0a45-44ed-8cac-695aa78e796e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.418742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770db9d-bce2-4f72-ad17-9fae5f7be8bc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.440204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 228/466] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:06 2022] POST /identity/v3/users => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:06.443569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.444252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.444948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.467520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.468144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.468428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.468705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.469436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:06.469735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.471060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:06.471265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.473135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:06.487879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 239/467] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:06.493565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.536214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:06.627515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:06.634340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 229/468] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:06.634340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.745231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ee6b-4f13-47d1-a20e-7c440a7a7914 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.791208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c153a1-199d-4dd3-863a-58aea64a5b23 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:06.797998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.799022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.799512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.799986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.800861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.803115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da0ffa-4df3-4bef-a955-88f155c8500c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.828911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 240/469] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:06 2022] POST /identity/v3/users => generated 248 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:06.830664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156276c-8587-4244-a0c5-e2106dc4ab4a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.831186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156276c-8587-4244-a0c5-e2106dc4ab4a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.831714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156276c-8587-4244-a0c5-e2106dc4ab4a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.833722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 241/470] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:06.840228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.840865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.841365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.845072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:06.845738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:06.846076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:06.846458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:06.865980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:06.866782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:06.868363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:06.868605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:06.890859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:06.891862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:06.892781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:06.892781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:06.892781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:06.892967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 230/471] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:06.899620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:06.941388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:06.969411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 242/472] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:52:06.969411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.071080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:07.111747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee799f-abca-4f50-bd43-c44dce613542 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.163470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.163740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.163890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.164213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.164778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:07.165085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:07.166559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:07.186346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 231/473] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:07.189196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.192649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6fb80-a0af-4b14-b4ef-656bcef50261 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.240949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.241774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.242156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.242553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.255559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:07.257196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:07.275380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:07.276568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:07.277646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:07.277646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:07.277646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.278177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 243/474] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:07.279109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.293526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:07.334973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6a4-8abd-497b-97a5-e0ec4547d856 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.395211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.396373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.396841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.397306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.399010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:07.401323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:07.415633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:07.439755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb0c-b7bd-4647-9fb3-a632602b1d22 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.446109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 232/475] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:07 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:52:07.447791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.488129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.489126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.489574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.490002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.490914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:07.492620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:07.501397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.sql.core [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 09:52:07.501397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 09:52:07.501397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [parameters: {'id': '9411bbea033840db823add02bfd04f54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 09:52:07.501397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 21 09:52:07.521576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return ref.to_dict() Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:52:07.522956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application yield resource Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise self.value Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application session.commit() Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 09:52:07.524024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.session.flush() Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application compat.raise_( Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 09:52:07.524942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:52:07.525860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application result.read() Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:52:07.526807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [parameters: {'id': '9411bbea033840db823add02bfd04f54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:07.527703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 09:52:07.528707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.532219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 244/476] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 21 09:52:07 2022] POST /identity/v3/roles => generated 144 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:07.541538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.688627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360521-297f-455a-a183-5beeeba9e506 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.740019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578660-160f-4568-8cf5-1fcbd39b9e57 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:07.773027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:07.783405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.784448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.784936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.785459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.785772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:07.786823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:07.787302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:07.787774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:07.789084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:07.789572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:07.792282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:07.799769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:07.805716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:07.806734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 09:52:07.807533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:07.810343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 245/477] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:52:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:07.817149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 233/478] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:07.820788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.827241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:07.835951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:07.960149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bb92-3aa0-4ff0-b688-fb7dc7a810c9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:08.060785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:08.062207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:08.063013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:08.063721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:08.065179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:08.065981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:08.068788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dd12-67c9-466a-ad4b-6f46c6528836 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:08.075587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688ded-6924-4c40-9838-9503cc0be54a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:08.086559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 246/479] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:08.148738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:08.149758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:08.150278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:08.150732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:08.151813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:08.154436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b9433-fb87-4857-a6b9-1af303b04856 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:08.202336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 234/480] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:07 2022] POST /identity/v3/users => generated 249 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:52:09.430480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56254-deed-49db-923e-b69cf77762ad None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:09.431037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56254-deed-49db-923e-b69cf77762ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:09.431037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56254-deed-49db-923e-b69cf77762ad None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:09.432676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 247/481] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:09.438530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:09.438989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:09.439073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:09.467523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:09.468729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:09.534350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:09.571121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 235/482] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:52:10.034740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56254-deed-49db-923e-b69cf77762ad None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:10.140280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:10.195583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56254-deed-49db-923e-b69cf77762ad None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:10.248382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:10.249067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.249348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.249627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.265750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:10.272512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:10.273619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:10.274463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:10.275086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 248/483] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:10.281320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:10.425226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78986ab-e7f1-4e54-82e1-d5264459015d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:10.469390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:10.470173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.470371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.470566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.471255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:10.471560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:10.473506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800dc14-8f7e-4570-9cd0-6965c58f5a38 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:10.484045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 236/484] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:10.489916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:10.598609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9606-79e2-47ab-979b-19edcc5e4819 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.598961 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9606-79e2-47ab-979b-19edcc5e4819 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.599171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9606-79e2-47ab-979b-19edcc5e4819 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.601018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 237/485] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:52:10.613619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.613921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.614178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.646673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:10.647891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:10.673471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2d9c-fdf7-4f58-a303-288f992c2648 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:10.709562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:10.738915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:10.753464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:10.754680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.754964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.756817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.780528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:10.782052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:10.790378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 238/486] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:10.807972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:10.808957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:10.809811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:10.809811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:10.809811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:10.809811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 249/487] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:10.816126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:10.942153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cac84-354e-47ab-a2bd-cb168d346a44 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:10.981426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:10.981946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:10.982223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:10.982529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:10.983194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:10.983499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:10.984897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:10.998363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 239/488] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:11.006957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:11.155699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839982fd-d8f7-4014-b1c3-e1c67cca85fd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:11.222176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:11.223499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.223792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.224064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.233423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:11.234909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c74b9460-8cac-4765-974a-0a05451f711a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:11.252557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:11.255803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:11.259327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 250/489] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:11.272276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:11.272635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083ef2-21ba-4d4a-9fd4-afcae299d305 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.272635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083ef2-21ba-4d4a-9fd4-afcae299d305 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.273049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083ef2-21ba-4d4a-9fd4-afcae299d305 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.274490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 251/490] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:11.281224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fa85c-a498-431d-9b8c-66029f29b36e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.281597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fa85c-a498-431d-9b8c-66029f29b36e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.281828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fa85c-a498-431d-9b8c-66029f29b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.320435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1d2fa85c-a498-431d-9b8c-66029f29b36e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:11.321692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1d2fa85c-a498-431d-9b8c-66029f29b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:11.340444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:11.395306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:11.461361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 252/491] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:11.464965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993f82-3ca1-4055-b54e-432e63898ab6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.464965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993f82-3ca1-4055-b54e-432e63898ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.464965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993f82-3ca1-4055-b54e-432e63898ab6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.464965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 253/492] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:11.464965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e993f82-3ca1-4055-b54e-432e63898ab6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:11.472770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0028f-3eee-4ed5-a9aa-b543ab7923ee None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:11.531436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:11.532348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.532643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.532921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.533794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:11.534104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:11.535773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83914-0f90-4ec1-acec-b5d793e34a0a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:11.583011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 240/493] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:11.585252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.585252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.585252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.610396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:11.612401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:11.661295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e993f82-3ca1-4055-b54e-432e63898ab6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:11.706264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:11.706933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.707299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.708182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.713365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 241/494] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:11.714640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:11.732070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:11.739096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:11.744923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:11.746112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:11.747133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:11.754922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 254/495] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:11.759719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:11.799560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:11.836914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb2c3-224b-4f74-9588-6a18947e7168 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:11.882715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:11.883756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.884208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.884638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.902825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adaa0d-c5c0-451e-bada-7ea07ff503b7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:11.970180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:11.971286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:11.971791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:11.972281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:11.973580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:11.974115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:11.976593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:11.982023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:11.983843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93c9e2-bff8-4d13-a71b-2000bd778c2c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:11.993394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 255/496] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:11.995097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.015275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.106544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.114896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869a1e-dab3-41f9-b992-079b6660018a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.131129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 242/497] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:12.132725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bdcc-c950-46dc-96d6-456b15c1e819 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.133101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bdcc-c950-46dc-96d6-456b15c1e819 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.133489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bdcc-c950-46dc-96d6-456b15c1e819 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.135115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 243/498] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:12.136771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bdcc-c950-46dc-96d6-456b15c1e819 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.159353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.160391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.160860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.161306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.179884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:12.191489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:12.193085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 256/499] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:12.198538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.261861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bdcc-c950-46dc-96d6-456b15c1e819 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.281358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.306489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.307530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.308032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.308494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.332500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:12.335417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:12.346134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c245b7c-5a43-4a5d-80ff-67986d21840f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:12.365498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:12.366619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:12.367533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:12.367533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.367533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:12.367533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 244/500] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:12.368941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.396478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.397146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.397428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.397703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.409862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:12.412003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7996e8a1-4983-46ad-8f76-8b2c675fc6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:12.435086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:12.436086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:12.436944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:12.436944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.436944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:12.438476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 257/501] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:12.439519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.440007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.440634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.463849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.473829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:12.476061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:12.529568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f3bb-f72f-43f4-acec-1708d6bd1669 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.583872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.584618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.584938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.585251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.590031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 258/502] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:12.591580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.600686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:12.602232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:12.620194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:12.621908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:12.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:12.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:12.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:12.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 245/503] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:12.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.660250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.790336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89ec5-2d39-4fbd-b912-3d33c2014ac2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.807540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e8a0-4115-4d5f-a864-e0c3d61e560d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:12.843770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.844838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.845377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.845855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.847057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:12.847592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:12.850726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:12.864291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:12.865401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:12.865780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:12.866101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:12.866888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:12.867246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:12.868833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:12.872319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:12.878329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 246/504] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:12.880954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:12.886987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 259/505] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:12.888262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.020441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.041861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944f20f-e88f-4a2d-be6c-291c6d347637 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.054225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f634-2374-4619-9aa1-676fd61dbddd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.081360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.081984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.082857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.083132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.083788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:13.084094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.085527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.096302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.096926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.097205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.097620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.098189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:13.098529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.099937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.100209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 260/506] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:13.101153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.119191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 247/507] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:13.120627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.168864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.223648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49d2b-de61-40f3-9bfe-db380350ce07 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.260476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3f9-9e52-48b0-9217-fbb89f33231f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.268844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.270508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.270970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.271409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.283328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.285834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:13.306506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:13.307818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:13.308981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 261/508] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:13.310507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.318177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.318957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.319296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.319629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.345469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.348324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.351543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:13.368321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:13.377151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:13.379021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:13.379021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:13.379021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:13.379021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 248/509] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:13.379021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.450142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea74b-b78f-4261-af3d-db88945ac597 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.474515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.502610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.503591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.504574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.505022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.521193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:13.526310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9749e-9c48-4139-a990-6cf4c167d154 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:13.530477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:13.531918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:13.533274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 262/510] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:13.535920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.577401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.578402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.578744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.579013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.587152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.588736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:13.603483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:13.605536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:13.607592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 249/511] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:13.609541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.682089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c8b2-3df5-490d-90d3-e3b1361c66d2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.690230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.730196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.731131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.731529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.731961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.732842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.734533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.756548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e83a3-f86e-4824-b7c4-2c4d011bfd75 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:13.761434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 263/512] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:13 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:13.762861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.813618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:13.815315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:13.816732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:13.817631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:13.819168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:13.819828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:13.821750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:13.824898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:13.862312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 250/513] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:13.862312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:13.948786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd8a3-4781-4cf9-a95d-77ee3b2210ae None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.008221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e8f0-19f7-46ee-8c1d-5edbfb03ecb5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.008995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.009734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.010109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.010560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.011345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:14.011825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.013433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.030838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 264/514] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:14.032030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.032888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:14.069725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.070729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.071185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.071627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.072812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:14.073227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.076349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.092606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 251/515] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:14.093431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.197656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:14.210548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716e97e-ee50-4162-99b0-561223e26ca7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.251084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9937-ff61-49a1-b8bb-bddb1160379c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.273903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.274813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.275291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.275760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.276935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:14.277444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.280099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.312928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 265/516] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:14.312928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.328427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26260-049c-4996-a328-03858662658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.329418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26260-049c-4996-a328-03858662658b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.329876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26260-049c-4996-a328-03858662658b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.330387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26260-049c-4996-a328-03858662658b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.393352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:14.426771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26260-049c-4996-a328-03858662658b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.429840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26260-049c-4996-a328-03858662658b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.483752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44576ac-c987-4769-b0ab-56146075f6fd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.540892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.541732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.542144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.542585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.551466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.553579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:14.567978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:14.569642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 266/517] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:14.571326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.594540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:14.626707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 252/518] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:14.628177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26260-049c-4996-a328-03858662658b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.727803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc0f5b-fdc0-4e9c-81f6-380ab81f056a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.772233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:14.786357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.787839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.788328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.788802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.803532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26260-049c-4996-a328-03858662658b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:14.808609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.811362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:14.840894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:14.844055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:14.846060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:14.846060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:14.846060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:14.846060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 267/519] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:14.849360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:14.850114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:14.850604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:14.851006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:14.851889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:14.852139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.852393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:14.854347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:14.871563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 253/520] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:14.871563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:14.983579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:15.058858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c393f-0c3a-4aaf-a293-167cff13fc22 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.071987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2224a0-4e4a-4ecc-8993-ac1ad2b943dd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.136914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.138355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.138829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.139959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.141650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:15.142224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:15.145311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:15.148302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.149530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.150027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.150576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.165320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:15.174574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:15.178336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:15.211115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:15.213045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:15.215245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:15.215245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:15.215245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:15.220186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 254/521] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:15.222025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:15.229057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 268/522] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:15.239451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:15.468860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b61be5-9ac8-4179-9525-75ff1ca12316 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.470478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9631-41dc-4023-a95e-82ad00ba0c6b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.530830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:15.540615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.541988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.542524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.543009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.544169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:15.544699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:15.547290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:15.556485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.557853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.558620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.559319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.560726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:15.562418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:15.566107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:15.577965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 255/523] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:15.577965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:15.613810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 269/524] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:15.613810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:15.710762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:15.810965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2207e-6841-448e-8f04-63fc4d51e207 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.838124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e532-251b-41f4-b411-b66b78be6d88 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:15.875445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.876455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.876916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.877387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.906594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:15.908677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:15.909490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:15.910857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:15.926217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:15.929558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:15.953372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:15.955170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:15.956827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:15.961895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 270/525] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:15.963725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:16.015155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.017925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.056757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.120559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.167855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96228f1d-681a-413c-8484-8a83d03a5c49 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:16.230381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:16.231985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.232263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 256/526] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:16.233017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.233714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:16.234193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.248406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.251470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:16.274508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:16.275977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:16.277636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:16.279641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 271/527] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:16.280505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:16.437131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59f5a-6e2e-43e5-a419-9930717fd82f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:16.441500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017627fe-2803-493a-b930-a3a5a775d622 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:16.445689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.489748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:16.490407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.490681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.490958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.491693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:16.491998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.493450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c1c6-5fd9-4830-be41-08fc2e33d387 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.505987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:16.507061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.507547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.508013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.517932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 257/528] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 21 09:52:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:16.517932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca599aab-2199-464b-b0b3-d5181fb94b37 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.517932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca599aab-2199-464b-b0b3-d5181fb94b37 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.517932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca599aab-2199-464b-b0b3-d5181fb94b37 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.521072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 258/529] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:16.521964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca599aab-2199-464b-b0b3-d5181fb94b37 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:16.526925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.529596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.533224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:16.557060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:16.558064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:16.558975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:16.558975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:16.558975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:16.562561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 272/530] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:16.563700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:16.665242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca599aab-2199-464b-b0b3-d5181fb94b37 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:16.705639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490795c7-b7d5-4cf0-81ae-0b273802595b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:16.709866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:16.710517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.710800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.711075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.711779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:16.712088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.713530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85fb3-1589-4840-856c-472fa01fb904 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.734013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 259/531] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:16.735315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.735600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.735993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.752555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:16.753444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:16.754406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:16.754821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:16.756152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:16.757390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:16.789296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.852222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:16.855490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:16.856976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:16.870662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 260/532] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:16.871931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.001981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 273/533] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:17.002882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.062580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26031589-69ca-47d6-9682-fb5c1c7ca3eb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.090821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.116652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.118420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.119183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.121168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.122710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:17.123536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.126385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.147659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 261/534] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:17.148887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.169990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1acca0-32ec-4743-82e7-f8e8c5fb2ee8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.218993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.220130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.220330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.220739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.221163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.221911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=4480ebef3a0f4a2cb5a2508ff9e0ded0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:17.222386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.224309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.241481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 274/535] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/role_assignments?user.id=4480ebef3a0f4a2cb5a2508ff9e0ded0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:17.241481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.293928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5e4c-9671-49cf-b070-41662ba5ea9d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.336820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.337897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.338271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.338624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.354455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.356294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:17.375831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:17.377606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:17.379928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:17.379928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:17.379928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:17.379928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 262/536] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:17.379928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.436980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f7e9-30f0-4a9b-b7a6-4b9f919bcb8f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.479603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.509692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.510487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.510775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.511226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.525514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:17.530945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452ba85-a023-426d-ab73-6b7c87416f99 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:17.536687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:17.537840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:17.538821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:17.539436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 275/537] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:17.540758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.549219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.581292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.582257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.582704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.583136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.593038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.595017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:17.611886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:17.612977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:17.615064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:17.622303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 263/538] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:17.622303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.734308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef56-7ff5-4869-ac88-6fa8f7e6a417 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.755656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfabc4-d738-4468-86d2-68c588269da8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.794279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.794279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.794579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.794801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.798269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:17.798269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.798269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.811032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:17.811679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:17.812023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:17.812360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:17.813097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:17.813464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:17.813576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 276/539] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:17.815063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.815181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:17.825421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 264/540] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:17.826676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:17.861742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.901817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:17.965392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fecef-6869-4444-91fc-27e8d67ba1f4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:17.973637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375356-bb8b-4775-8f4a-231244f58d2b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.011361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.012300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.012583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.012858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.016311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.017056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.017410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.017903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.018875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:18.019271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.020600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.021095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c506-1e21-49c4-8b2e-dccbf02079ce None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.022039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:18.034208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:18.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:18.036014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:18.040261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 265/541] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:18.040922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 277/542] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:18.041157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.042434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0c7df-f66d-47bd-8a9b-692b19c0986a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.042721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0c7df-f66d-47bd-8a9b-692b19c0986a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.042994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0c7df-f66d-47bd-8a9b-692b19c0986a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.044453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 278/543] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:18.049264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0c7df-f66d-47bd-8a9b-692b19c0986a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.154556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:18.162103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:18.167006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0c7df-f66d-47bd-8a9b-692b19c0986a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.167600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b23633-4738-4eab-ad7d-4c0783a49c26 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.209419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.210057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.210373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.210651 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.224632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.226140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.227922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.228896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.229340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.229665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.230452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:18.230761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.232550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc0c4-0518-42f8-a3cc-a016dae528fe None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:18.244394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:18.245794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:18.246954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:18.246954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:18.246954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:18.250275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 266/544] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:18.251216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.262633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 279/545] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:18.264937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.265224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.266026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.284431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:18.286132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:18.366955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 280/546] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:18.368159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.408552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bddb9-628b-4436-8005-dcd655e1d5d3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.468962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.470082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.470704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.471116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.472033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=97c7227deb9048398d33ff330b8df8f1) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:18.473057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.475241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.488089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 267/547] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/role_assignments?user.id=97c7227deb9048398d33ff330b8df8f1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:18.490620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.506892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:18.507545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:18.522875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b88e5-a81c-425c-8fad-c88c7f0bb2f7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.587392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.588722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.589261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.589777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.590884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:18.591870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.594796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.633690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 281/548] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:18.641433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.645383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7ad0-80da-4912-91e0-8f16c81accf2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.727400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.728026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.728308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.728586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.729329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d823e9d31401459cbf02d9360e9c8e1f) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:18.729641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.731167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:18.739416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 268/549] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/role_assignments?user.id=d823e9d31401459cbf02d9360e9c8e1f&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:18.770692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:18.864662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35aebb-92cc-4419-ad6c-3f3b37db4fc4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.903993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:18.947080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:18.948354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:18.948943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:18.949524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:18.954201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f174b-49ed-4c04-b142-a71e7f345c3b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:18.976250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:18.979343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:19.000565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.001206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.001481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.001753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:19.002086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:19.002992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:19.004449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:19.007428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 282/550] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:19.014809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:19.015208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:19.021078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:19.022219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:19.023089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 269/551] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:19.039893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:19.040727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.190672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491aaf2-d0af-459a-a12e-09bb0e7e29b5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:19.225811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:19.235348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1866-f211-4723-885a-24b57097ea99 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:19.238434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.239065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.239342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.239613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.240291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:19.240593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:19.241970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:19.266728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 270/552] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:19.275335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.277327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.277962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.278235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.278558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.279309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:19.279618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:19.281085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:19.300554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 283/553] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:19.307066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.398639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:19.433776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184620-4d71-426a-9471-5a87f31babd7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:19.475558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.476519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.476847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.477230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.560800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:19.562561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:19.645026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d457-4945-4202-88aa-f8cf815ea660 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:19.653634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:19.730490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 284/554] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:19.736799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.783040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.784382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.784887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.785406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.798084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:19.799988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c34006f5-2044-4d71-8d83-40edeb065f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:19.817995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:19.819211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:19.820208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:19.820208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:19.820208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:19.822520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 271/555] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 548 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:19.824279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209538c7-4bc8-4d31-8397-4d97b39e7049 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.824766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209538c7-4bc8-4d31-8397-4d97b39e7049 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.825255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209538c7-4bc8-4d31-8397-4d97b39e7049 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:19.827421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 272/556] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:19.828609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209538c7-4bc8-4d31-8397-4d97b39e7049 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:19.899595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7852d0-ab18-4960-97de-8682155ecc34 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:19.936895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:19.971938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:19.974465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:19.974967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:19.975463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.000030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.004237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.020922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209538c7-4bc8-4d31-8397-4d97b39e7049 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4a357eb5-9e04-4a28-af7b-0877b2dace44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:20.042454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:20.044277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:20.045153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:20.045153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:20.045153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:20.045153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 285/557] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:20.047109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.047603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.048089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.069407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.070454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.070941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.071414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.072270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:20.072808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.074464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.084658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:20.087297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:20.090574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 273/558] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:20.091786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.115893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:20.185175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 286/559] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:20.186094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.297201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf4ff-ea41-473a-8a4d-46687156a60d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.314836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:20.384090 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.384718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.384997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.385272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.385930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:20.386326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.387714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.413331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 274/560] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:20.416572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.432227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8c476-0c04-4bf0-ae50-774ab692b740 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.489435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.490603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.490877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.491559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.501769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.504833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:20.522415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:20.524288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 287/561] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:20.526967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.542475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:20.567287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afb4a-47ea-4d98-8252-e5ab7ab55f36 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.609770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.610804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.611423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.611885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.621238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.623188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:20.637216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:20.638206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:20.639150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:20.641863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 275/562] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:20.643176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.682643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:20.756510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec6df-84c2-4703-affd-309fd137220e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.819106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.819985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.820619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.821033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.833917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9039c-dbee-4b59-982b-f83fcf031d5d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:20.840893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:20.853227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:20.855457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:20.857041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:20.862220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 288/563] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:20.864107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.908167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:20.909606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:20.910543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:20.911285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:20.912847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:20.913655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:20.917197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:20.956322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 276/564] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:20.959060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:20.993572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.055613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda67805-2219-4cb7-936d-cfb6af5ec23b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.122872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.123764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.124237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.124706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.125953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:21.126582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.127856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.130805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.156637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 289/565] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:21.158200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:21.158637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b4ec-a9ca-489f-b0a6-ea36980f7087 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.229340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.229969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.230273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.230575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.231295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:21.231602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.233117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.249231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 277/566] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:21.249231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:21.326625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12427fc-4f68-4650-8113-1908c7a84986 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.363700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.370650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.371567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.371883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.372192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.384089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7912-ce17-4322-9b6d-a0a605dcd48c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.384463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.385942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5fc9b1b0-149e-4382-bf35-5db61da74e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:21.401858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:21.409877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 290/567] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d02a8-4049-41a5-93e2-f2caab009983 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d02a8-4049-41a5-93e2-f2caab009983 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d02a8-4049-41a5-93e2-f2caab009983 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 291/568] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:21.412121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d02a8-4049-41a5-93e2-f2caab009983 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:21.428041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.428683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.428974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.429246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.429975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=894ed64582f5481f8e5c5c70bb901e0b) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:21.430315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.431782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1589-23fc-4911-a6b4-aac8041745bc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.437783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 278/569] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/role_assignments?user.id=894ed64582f5481f8e5c5c70bb901e0b&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:21.439404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa87c-fe28-4aa5-8979-072e6c2cf6ed None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.439873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa87c-fe28-4aa5-8979-072e6c2cf6ed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.440293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa87c-fe28-4aa5-8979-072e6c2cf6ed None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.442520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 279/570] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:21.443752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa87c-fe28-4aa5-8979-072e6c2cf6ed None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:21.463676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.541607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d02a8-4049-41a5-93e2-f2caab009983 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.585235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.585902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.586393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.586676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.591366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa87c-fe28-4aa5-8979-072e6c2cf6ed None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:21.600722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.602627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-faf59ba6-3aad-4c8d-bca9-494233c31d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:21.629912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:21.630946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:21.631823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:21.631823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:21.631823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:21.634540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 292/571] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:21.635834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e387-8010-4387-9836-d875799da317 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.636126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e387-8010-4387-9836-d875799da317 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.636399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e387-8010-4387-9836-d875799da317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.651533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:21.652420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.652884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.653260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.654147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:21.654597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:21.656133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c365-5640-4707-bfad-23b86872a6ef None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:21.658464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-63f0e387-8010-4387-9836-d875799da317 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:21.659819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-63f0e387-8010-4387-9836-d875799da317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:21.672843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 280/572] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:21.675468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:21.676016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:21.676504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:21.698066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:21.704231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:21.713096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.778275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 293/573] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:21.778275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e387-8010-4387-9836-d875799da317 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:21.830220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:21.843602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 281/574] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:21.844998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.047705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278156b4-8d8f-4e78-8aff-432acc590220 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.088314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e387-8010-4387-9836-d875799da317 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.117884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.118975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.120292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.120757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.134568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:22.137332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:22.162325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:22.164103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:22.165838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:22.173312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.181877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.183448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.184287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.185056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.186639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:22.187472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:22.190329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:22.213096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 294/576] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:22.223533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.274716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:22.348727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:22.440881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2a43-7989-4ca3-bb81-335bbca2b679 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.444310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151d0a-d134-448a-a1b1-75141862b93c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.510740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.511734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.512176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.512644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.513911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:22.514843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:22.517563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:22.519165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.520724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.521347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.521794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.538372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:22.540654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 283/577] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:22.540948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:22.541901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:22.566353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:22.568158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:22.569917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:22.570948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 295/578] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:22.573729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.700113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fef20a-2877-47f7-bb72-c22652d35a11 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.723858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:22.734601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:22.752847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.753493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.754338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.754623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.759150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d216fd-6282-4ddf-9d94-ef2f8be09e24 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.766927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:22.773001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:22.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 284/579] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:22.775173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.808679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.809341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.809622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.809892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.826939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:22.839521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:22.840731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:22.841814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:22.846426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 296/580] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:22.847696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:22.901349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99be00-6854-4b12-8da5-311e322f3a3b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:22.939320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:22.939987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:22.940265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:22.940553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/2e8b89a267e94b36953f502498800222` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:22.966434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=3be328584a6549aeb096ab9b852daf9d, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:22.969401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:22.992291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 285/581] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:22 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:22.993751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.006906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc701d7-7c25-44fa-84a1-6df71b6ac01d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.049789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.051525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.052061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.052642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.053750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:23.054402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.056169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.058167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.081055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 297/582] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:23.083285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.086912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.165138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df7b5-54cc-451a-8659-ad9e83c6249f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.207287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.208629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.208972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.209249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.209929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:23.210230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.212320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.223585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 286/583] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:23.224407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.286074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81cfc4-eefb-4b59-bbcb-41afa34bae91 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.338327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.349857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127b39d-9379-453d-aade-fcdca7c00990 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.354314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.355560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.356299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.356980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.358471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:23.359226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.361998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.380028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 298/584] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:23.381981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.390941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.391591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.391872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.392200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.405659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.408049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:23.427720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:23.429653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:23.431628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:23.431628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.431628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:23.433776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 287/585] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:23.434800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.508312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.570928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f289356-6aa1-4e67-a71f-05702352e7b8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.589705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970738af-2e33-4d8c-abc6-b5c6a95ccba9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.618370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.619390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.619690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.619967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.631598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.632688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.633179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.633658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.633947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.635538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.647741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.649213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.652312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:23.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:23.658115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:23.659037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:23.659037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.659037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:23.660834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 299/586] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:23.661741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:23.672410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:23.673439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:23.674374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:23.674374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:23.674374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:23.676740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 288/587] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:23.678026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.812039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d84c-d757-4eff-86e2-1a18fc7886bb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.816194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98095-6807-490d-8403-d35bbd46b0a0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:23.848203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:23.882209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.883292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.883786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.883895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:23.884414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.884988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:23.885495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:23.885766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:23.886043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:23.886499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.887300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:23.887842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:23.888700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.890763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:23.905942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 300/588] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:23.907237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:23.915696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:23.917262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.014406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:24.059927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a209-ac0d-4269-80b7-84e866c97dbf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.097503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee86081-0785-4e04-b154-5b9ecec1f7f9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.108694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.109832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.110408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.110965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.112237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:24.112907 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.115962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.137365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:24.139004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.157277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.158399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.159016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.159497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.172823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.176590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:24.201766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:24.203745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:24.205720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:24.210557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:24.212362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.220870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:24.387471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690af2-35c4-4caf-bf9e-8765af1183fd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.429898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f749-033f-4939-b118-e94a94453c08 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.452956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.453608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.453896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.454354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.463972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:24.464239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.465496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:24.478702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:24.480533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 302/592] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:24.482397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.497272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.497907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.498180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.498476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.508596 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.510038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-47e3bf05-acb5-4eeb-82e0-641cc5533d18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:24.525338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:24.527197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 291/593] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74a5c-bd44-4378-be0b-766c5d05387b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.529027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74a5c-bd44-4378-be0b-766c5d05387b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.531613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc74a5c-bd44-4378-be0b-766c5d05387b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.534410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 292/594] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:24.536928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74a5c-bd44-4378-be0b-766c5d05387b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.673817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc74a5c-bd44-4378-be0b-766c5d05387b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.676805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:24.688067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1bd48-fd81-423e-b754-b1e12a0aa6c0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.726429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.727131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.727474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.727791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.728601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:24.728962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.731081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.752908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 293/595] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:24.754356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:24.763493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53617559-153d-43de-9ef8-937603851ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:24.764512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617559-153d-43de-9ef8-937603851ebe None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.765009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617559-153d-43de-9ef8-937603851ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.765477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617559-153d-43de-9ef8-937603851ebe None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.766800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617559-153d-43de-9ef8-937603851ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:24.767503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617559-153d-43de-9ef8-937603851ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:24.770271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617559-153d-43de-9ef8-937603851ebe None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:24.797217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 303/596] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:24.797217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:24.797217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:24.797217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:24.808513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:24.827163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:24.828618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:24.919922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea0580-dc2f-4509-bfa2-eb2415e18527 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:24.920955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 304/597] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:24.921864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.007936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.008864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.009349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.009812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.011240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:25.011868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.014751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.056887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 294/598] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:25.056887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.114913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:25.152316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752bb4-9ceb-4212-88b7-f1b1aab8474b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.218718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.220050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.220327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.220880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.239891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.241577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.257079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:25.261430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:25.271418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:25.273254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:25.273254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:25.273254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:25.273254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 305/599] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:25.273254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.284593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2850f-2e73-4ab3-83ff-a2023a139248 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.337490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.338332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.338645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.338893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/4480ebef3a0f4a2cb5a2508ff9e0ded0/roles/2e8b89a267e94b36953f502498800222` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.368556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=4480ebef3a0f4a2cb5a2508ff9e0ded0, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.371397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.394862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 295/600] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:25 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/4480ebef3a0f4a2cb5a2508ff9e0ded0/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:25.396170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.442815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb233-e3e0-4b9e-94bd-e01a302ee182 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.495554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.496656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.497185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.497722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.510095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:25.517394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.519529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:25.549439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:25.551037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:25.551958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:25.551958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:25.551958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:25.558409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 306/601] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:25.559755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.574684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9ca6d-9c90-4d91-af07-1d80e8672dcf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.632328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.633684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.634197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.634702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.647314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:25.652761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:25.653765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:25.654652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:25.657065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 296/602] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:25.658147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.661852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:25.790896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bedc8-4cd1-4d58-9251-95317453ade8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.843083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.843899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.844187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.844545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.845285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:25.845596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.845700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d621bf-7886-4433-862e-44317cc0f4fe None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:25.847191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.868050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 307/603] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:25.869346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.895510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:25.896636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:25.897114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:25.897626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:25.898528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:25.899174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:25.900879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:25.914455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 297/604] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:25.916576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:25.955190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.010578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.011261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627749-bd06-4bc3-9f1b-499ea52b46a7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.055354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.055897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.056189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.056482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.057123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:26.057425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.058878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c8826-e316-44de-8b55-9f44ff5913ef None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.059980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e19c4-40ff-40e5-a1c8-2e433e3a1899 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.072504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 308/605] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:26.074180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082731-dad1-4a0e-b4fd-52f32dce5b27 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.074667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082731-dad1-4a0e-b4fd-52f32dce5b27 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.075047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082731-dad1-4a0e-b4fd-52f32dce5b27 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.076844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 309/606] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:26.078971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b082731-dad1-4a0e-b4fd-52f32dce5b27 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.111997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.112639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.113523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.113750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.121191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.122685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:26.134922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:26.144040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 298/607] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:26.148157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.218392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b082731-dad1-4a0e-b4fd-52f32dce5b27 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.240257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.267810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.268635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.269055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.269874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced1697-ea63-47f0-b3c9-f89c0429e833 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.270146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.278123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.279671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d311a0b8-30fb-42c2-89f9-3be857c9f5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:26.292780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:26.293744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:26.294760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 310/608] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:26.295261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.296017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.296017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.312721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.315416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:26.316739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:26.328920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.329883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.330337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.330749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.347965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.349594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:26.365909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:26.367143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:26.373479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:26.373479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:26.373479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:26.373479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 299/609] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:26.373479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.426276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 311/610] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:26.426276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.544513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86e95-b631-476a-b0e2-b2feced68b97 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.566420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e971e0-c046-4ef5-9005-44ddbc993c1c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.568745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.616554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.617352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.617701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.618042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.618894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:26.619293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.620204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.620881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.621147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.621571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.622052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.623047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:26.623504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.625199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.635047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 300/611] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:26.636546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.641216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 312/612] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:26.643096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.683104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.776101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd426077-3af2-4465-9beb-acaf2ef84fa3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.813603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.814488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.814738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667daa78-7535-4588-9b7f-92dae37bccc1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:26.814881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.815256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/97c7227deb9048398d33ff330b8df8f1/roles/2e8b89a267e94b36953f502498800222` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.831706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=97c7227deb9048398d33ff330b8df8f1, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.833105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.854287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 313/613] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:26 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/97c7227deb9048398d33ff330b8df8f1/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:26.854287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:26.877643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:26.887893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:26.888785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:26.889179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:26.889600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:26.890437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:26.890857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:26.893126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:26.924289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 301/614] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:26.924289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.028165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dac7-b52e-4c7b-8afc-86b2f12b7ae7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.082652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.083865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.084300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.084728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d823e9d31401459cbf02d9360e9c8e1f/roles/2e8b89a267e94b36953f502498800222` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.103738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=d823e9d31401459cbf02d9360e9c8e1f, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.104516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:27.106871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.114528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9b1bf-2378-42ab-8acd-326599bd4fa2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.124810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 314/615] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:26 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d823e9d31401459cbf02d9360e9c8e1f/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:27.125439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.188826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.191739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.192014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.192291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.219036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:27.230954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:27.231963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:27.232806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:27.239424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 302/616] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:27.250211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.279088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:27.390062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d9b4-cada-48ac-8d1a-a2ad37d72da5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.433229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.433875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.434157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.434466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.443799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.446389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.461546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15115f8-b68d-4584-a493-0340a538c33c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:27.463574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:27.464511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:27.465450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:27.468329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 315/617] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:27.479254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.580221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.581005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.581388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.581794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.582576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:27.582988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.584508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.603835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 303/618] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:27.609666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.619093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe421fa-ebcc-4350-a3bd-d22e24eaec0e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.650065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:27.656318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:27.675073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.676226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.678121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.678624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.679585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:27.680963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.683425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.734744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 316/619] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:27.739643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.863675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189887-0265-4cb2-b33a-0be7f2e5f5d7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.890302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b197e-5e0e-4c90-9877-7c2c156c1021 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:27.923465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.925117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.927496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.929675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.941312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:27.942394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.942874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.943369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.943483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.945066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.956288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:27.958672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-35ed6165-327f-4949-b178-863874de41f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:27.962606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:27.963586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:27.964455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:27.964455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:27.964455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:27.964455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 317/620] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:27.965282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac17f2-6ac6-409b-a4ca-3c1b4c552052 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.965564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac17f2-6ac6-409b-a4ca-3c1b4c552052 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.970678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac17f2-6ac6-409b-a4ca-3c1b4c552052 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:27.977160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 318/621] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:27.977160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac17f2-6ac6-409b-a4ca-3c1b4c552052 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c739814a-a5b5-43ec-9396-773617c10341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:27.988061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:27.989082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:27.989971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:27.989971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:27.989971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:27.992386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 304/622] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:27.994045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:27.994657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:27.995136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.015826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:28.017387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:28.029522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.106379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.110835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 305/623] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:28.112070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.133988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac17f2-6ac6-409b-a4ca-3c1b4c552052 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.183205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.183748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.184036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.184302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.185467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:28.185787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.187556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.205169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 319/624] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:28.212637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.288639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be071ffb-41b6-4d33-927d-7fb7c2282ace None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.359190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244cbe4-9ae0-4c1d-adaf-814c972cb36b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.363670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.409020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.410020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.410335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.410636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.420529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.422596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.422979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.423623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.423897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.424171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.424834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:28.425140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.427852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:28.440504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:28.442118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:28.443075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 320/625] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:28.449914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.468869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 306/626] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:28.475320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.580881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.636337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255121-2896-4934-b9da-9e9e8fe54918 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.641798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb245c9-43c0-4add-85a1-cd478c7e8901 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.677106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.677761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.678102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.678409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.687360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.689238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:28.710504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:28.711836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:28.713857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:28.718759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 307/627] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:28.719597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.719958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.721147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.721676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.722137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.723193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:28.723733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.725460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.749665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 321/628] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:28.751641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.780337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.836422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef544d9-dbf8-4262-be56-2b58f00f1a3f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.862570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:28.897141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.898446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.899038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.899594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.903717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac5b4-65dd-4b44-a0f6-a9620530ec33 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:28.921903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:28.934512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:28.935543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:28.936379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:28.937039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 308/629] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:28.943820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:28.945199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:28.946062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:28.946576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:28.947086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:28.948017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:28.948519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:28.950161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:28.971140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 322/630] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:28.972878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:29.052194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:29.086718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194fd35-bdab-4aa2-a2b3-575ffd95b84b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:29.126056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:29.127117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.127604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.128101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.129041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:29.129624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:29.131292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:29.141000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 323/631] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:29.142218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:29.173079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccc570-c14a-46df-a820-75c781fff9fa None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:29.236512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:29.237513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.238540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.239009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/894ed64582f5481f8e5c5c70bb901e0b/roles/2e8b89a267e94b36953f502498800222` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.256942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ec52-84a9-4b7b-bcb3-e5033ea10da7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:29.272233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=894ed64582f5481f8e5c5c70bb901e0b, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:29.275238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:29.295884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:29.309131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:29.309464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 309/632] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:28 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/894ed64582f5481f8e5c5c70bb901e0b/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:29.314267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.314267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.314267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.314584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:29.409203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:29.540743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:29.542110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be974d-924e-4d3b-8cf5-644246f4ba00 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:29.573068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c4366-d063-44ed-878a-2b1bbbe9ed16 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:29.619858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:29.620520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.620802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.621078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.633783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:29.635298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f4895003-c2a4-45fa-b1f3-196c90f6d7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:29.653237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:29.654269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:29.655177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:29.655177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:29.655177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:29.655177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 310/633] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:29.655830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3945e-6651-41d6-bc18-1d6171b7a992 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.655929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3945e-6651-41d6-bc18-1d6171b7a992 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.656220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3945e-6651-41d6-bc18-1d6171b7a992 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.657484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 311/634] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:29.671014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3945e-6651-41d6-bc18-1d6171b7a992 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:29.719986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 324/635] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:29.721129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fcdf-90c4-47ff-aeba-b94e583f8d0d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.721415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fcdf-90c4-47ff-aeba-b94e583f8d0d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.721693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fcdf-90c4-47ff-aeba-b94e583f8d0d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.723192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 325/636] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:29.724134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a087-0523-4900-a8f3-01a3688fadb3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.724417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a087-0523-4900-a8f3-01a3688fadb3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.724809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a087-0523-4900-a8f3-01a3688fadb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.747316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e192a087-0523-4900-a8f3-01a3688fadb3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:29.748548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e192a087-0523-4900-a8f3-01a3688fadb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:29.781703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:29.803059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:29.827957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3945e-6651-41d6-bc18-1d6171b7a992 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:29.862303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 326/637] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:29.862303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.862303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.862303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.877742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:29.879328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:29.879764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:29.880191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:29.881063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:29.881520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:29.883273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:29.893209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:29.896533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:29.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 312/638] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:29.899535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.008483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 327/639] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:30.009975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.071854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140eb07-d077-4d7e-8311-f38295dd2f2b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.133191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.143885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.144982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.145497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.145962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.148144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3852-9317-4a52-9b0e-e1e393a66c6b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.173366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.183158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.183158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:30.232873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:30.234111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:30.235098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:30.235098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:30.235098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:30.239528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.240594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.241080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.241557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.245371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 313/640] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:30.251060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.256147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.258046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:30.271428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:30.272465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 09:52:30.273401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:30.276054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 328/641] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:30.277188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.412535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e454-a162-4b7e-b9cb-7fa85943738d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.439961 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4c8c-c0ec-4953-a316-fd80e7e2be67 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.451367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.452313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.453006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.453283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.466070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:30.473823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:30.474936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:30.475814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:30.477165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 329/642] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:30.478145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.497824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.506158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.507341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.507838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.508327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.509533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:30.510044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.512676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:30.533335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 314/643] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:30.534573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.597761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.613790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a519d-d4a5-4edb-a4d9-51c7b42a0a88 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.657100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.657811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.658096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.658404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.659147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:30.659454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.661487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:30.684754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 330/644] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:30.684754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.684994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841577cb-3635-41cb-b0e1-a9165b03d8b6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.735649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.736923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.738376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.738801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.751984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:30.756996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:30.759395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:30.761226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:30.763655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 315/645] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:30.764067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.793722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.831031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9758-bc0e-45ab-9606-abc2960273a7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.873092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.874020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.874519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.874983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.875929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:30.876409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.878492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:30.889520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 331/646] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:30.890592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:30.918529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975abc91-7eba-4f79-a149-ace45e92c8eb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:30.935492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:30.974653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:30.975708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:30.976200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:30.976685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:30.988685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:30.991544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:31.011068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:31.013018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 316/647] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:31.014691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.034032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c225-a1b6-4b1b-8924-468234a4e7c0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.085619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.093251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.094019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.094388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.094676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.163134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef3240-ad83-423b-974c-4dbac6088221 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.198986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.200797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.219089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.219944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.220093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.220447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.221193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:31.221655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.224825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.240084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 317/648] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:31.241853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.303336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.383837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 332/649] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:31.383837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.418762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab012cc-d634-4bc9-bfd5-e666684c371e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.438885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.464700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.465364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.465642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.465914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.479115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.480580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:31.498453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:31.500077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:31.501872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:31.501872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.501872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:31.501872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 318/650] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:31.501872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.567895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a6-eede-4123-b9eb-82a5cb9f6cfb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.619778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.634389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.635439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.635931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.636406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.637870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:31.638077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.640529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.641288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e90c-5fbe-463c-b0dc-15d192621bb5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.660123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 333/651] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:31.660814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.715044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.715706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.716057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.716403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.730476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.732052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:31.751369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:31.754055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:31.763304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:31.763304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.763304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:31.763304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 319/652] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:31.763304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.841491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.860772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d8b6-6250-4722-8d43-a9f4105a17e3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.906645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013a231-aa1a-48b4-a8ad-e683e44dc3fd None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:31.910886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.912083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.912083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.912083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.923704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.925208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:31.940993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:31.943074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:31.945244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:31.945244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:31.945244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:31.945244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 334/653] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:31.945244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:31.963352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:31.964407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:31.964871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:31.965399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:31.966599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:31.967142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:31.969968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:31.984179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:31.999618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 320/654] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:31.999618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.099850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268db3b-353b-4ef4-90a8-692a90d35364 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.117667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145d0c-5a6c-4a53-ad49-6b02d3b990a5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.156011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.156639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.156917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.157182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.157838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:32.158138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.158584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.159552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.159754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78243b-ff1b-424f-8d96-ebb162f6a65e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.160585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.161046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.162412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:32.162970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.165574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.173258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 321/655] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:32.174447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887aa47-1953-43ef-af17-3b8811cdea6d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.174777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887aa47-1953-43ef-af17-3b8811cdea6d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.175059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887aa47-1953-43ef-af17-3b8811cdea6d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.177108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 335/656] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:31 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:32.178025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.183084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 322/657] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:32.184049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887aa47-1953-43ef-af17-3b8811cdea6d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.193190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:32.262874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:32.334747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887aa47-1953-43ef-af17-3b8811cdea6d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.366912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5a88-9aad-4974-a27e-eed984652802 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.386074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.387116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.387576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.388037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.402892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.405653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.427189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.427987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.428417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.428826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.429788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:32.430377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2153fd3b-7bc1-4844-90a8-6b6a0a38e2ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:32.430536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:32.439420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:32.442845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 323/658] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:32.445468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.445719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.445719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.445719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.454536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 336/659] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:32.455105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.460861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:32.462176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:32.562751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:32.598287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 324/660] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:32.598287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.645141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf557f-1fc7-4ccc-8ef1-e874827264ae None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.697340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:32.740700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.741889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.743079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.743688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.760387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.764308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:32.792284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:32.794039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 09:52:32.795877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:32.804241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 337/661] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:32.804241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:32.825777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c37b-f7a3-4ca3-aba2-b5d637fda07e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:32.893025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:32.894760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:32.895281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:32.895780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:32.897456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:32.897840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:32.900772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:32.934182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 325/662] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:32.936013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.011913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321addc6-5748-414e-b39b-726ecfe9faa8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.064292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.078324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.079250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.079717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.080179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.080608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5fd1-491a-4447-9a23-d6c788cd17bf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.091137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.093517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.096162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:33.118598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:33.119830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:33.121255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 338/663] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:33.123470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.135456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.137253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.137794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.138340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.139337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:33.139926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.142482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:33.181639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 326/664] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Sep 21 09:52:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:33.181639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.275680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c70d7f-2a53-4b35-ab09-a01d66aeabcf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.319085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.319929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.320337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.320759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.334355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:33.340632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:33.342768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 339/665] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:33.344409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.374203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944b86-5f23-4998-b94e-8c9001996185 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.431386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.440294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.441211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.441666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.441937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.485138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.532954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.533826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9f53-62d2-4656-a4ff-08b8854d0384 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.535390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:33.600275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.601266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.601799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.602536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.603930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:33.604479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.607327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:33.636019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 340/666] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:33.636019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.689809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 327/667] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:33.691712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.791382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c660e-3860-4580-bb77-ef4ab6087630 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.807054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.816241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:33.852843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.853783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.854312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.854665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.871530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea3d2-9829-4a63-a26b-a075f09111b0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:33.926894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:33.927950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:33.928458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:33.928926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:33.930158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:33.930744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.933399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:33.955643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 328/668] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:33.955643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:33.979339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:33.982091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.120936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1be30a-3b06-4777-868b-cdf9da2dbe35 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.153497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:34.160330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 341/669] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:34.162386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.173146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.174198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.174741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.175242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.176451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=4480ebef3a0f4a2cb5a2508ff9e0ded0) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:34.177002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.177502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:34.179647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.201999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 329/670] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:33 2022] GET /identity/v3/role_assignments?user.id=4480ebef3a0f4a2cb5a2508ff9e0ded0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:34.201999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.396287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b763b-ac36-4103-9cb4-f0e1602ea506 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.449135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215786ba-2422-4fe2-9215-b3940f1d8c4f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.465696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.466434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.466731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.466972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.483284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.484847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:34.520574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:34.523061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:34.524823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:34.524823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.524823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:34.524823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 342/671] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:34.524823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.525778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.529263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.529263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.529263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.552787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.556053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:34.583416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:34.585274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:34.587191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:34.587191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.587191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:34.587191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 330/672] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:34.588684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.653523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:34.684960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:34.724227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f1ff0-c28e-4f72-8607-15ce5d3c741a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.758654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478957-daf9-4984-9acc-fb3e63f5d913 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.784412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.786214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.786801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.787413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.801315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.802338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.802772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.803174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.803968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:34.804429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.805971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.810406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.813319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:34.820979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:34.822124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:34.844227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:34.845375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:34.846466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:34.846466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:34.846466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:34.856824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:34.858958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:34.945960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd941271-1c1c-4b8b-b836-1cf45e988d4a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:34.948137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:34.988772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:34.989710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:34.990130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:34.990582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:34.991391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:34.991838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:34.993654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.012480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:35.013627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.059133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332f9e8-e994-4b7e-a748-96bb3260325e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.077253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:35.118850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.119659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.120075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.120474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.132214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.134903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.140273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abc16-d397-4761-b8d0-e2c3a78a93f7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-69735237-2ca7-489f-8860-d7e725223fe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:35.155083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:35.156645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:35.158168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:35.163851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 344/676] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:35.165620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bc0db-cee9-459b-93a0-a06c35c22184 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.166068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bc0db-cee9-459b-93a0-a06c35c22184 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.166555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bc0db-cee9-459b-93a0-a06c35c22184 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.168804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 345/677] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:35.169738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bc0db-cee9-459b-93a0-a06c35c22184 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.203336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.204041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.204511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.204977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.205740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:35.206216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.208522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.224444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 333/678] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:35.225360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.258272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:35.321986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bc0db-cee9-459b-93a0-a06c35c22184 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.372701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac886f-cc34-446d-80a6-9726ef17664f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.386491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.387299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.387587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.388023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.399879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.401416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c96f90eb-7d46-4192-b806-822f483e7624 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:35.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:35.431428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 346/679] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388206-f19b-4709-a843-6f739ab0253c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.433275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388206-f19b-4709-a843-6f739ab0253c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.436973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388206-f19b-4709-a843-6f739ab0253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.444407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.445872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.446344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.446853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.447992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:35.448550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.451348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.451927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-32388206-f19b-4709-a843-6f739ab0253c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:35.452839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-32388206-f19b-4709-a843-6f739ab0253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:35.473488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 334/680] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:35.473488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.509171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:35.577235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 347/681] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:35.578987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388206-f19b-4709-a843-6f739ab0253c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.602436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:35.641891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc99dd-de9c-404f-86bd-5836b7f12c70 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.709379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.710194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.711429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.711830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.723763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.725830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.744444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388206-f19b-4709-a843-6f739ab0253c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:35.746923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:35.748027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:35.748951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:35.754453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 335/682] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:35.755702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.812110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:35.812802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:35.813130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:35.813806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:35.814726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:35.815194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:35.817437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:35.854336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 348/683] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:35.854336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:35.887124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:35.954079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc288b4-31f2-4231-b12a-7a33514d6de6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:35.982843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda115-c1b8-46b5-a4b9-bea9ff795828 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.014050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.014720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.014999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.015270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.016202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=97c7227deb9048398d33ff330b8df8f1) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:36.016518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:36.018518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:36.028085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.028700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.029182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 336/684] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/role_assignments?user.id=97c7227deb9048398d33ff330b8df8f1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:36.030686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.038795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.039350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.040605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:36.041172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:36.044004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:36.050992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:36.065501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 349/685] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:36.066389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.210447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:36.252902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922380-653f-415a-804a-f5e3aad773fa None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.262311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e166a-3e98-49b0-839c-22216616d2af None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.327099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.328231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.328862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.329195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.336285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.337289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.337721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.338189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.353520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:36.361447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:36.363832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 350/686] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:36.365837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.491714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:36.496491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:36.515522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:36.565129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04660-3880-4a1c-a21d-b1f6837bba9c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.634040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 337/687] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:36.635289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.637540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.639038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.639863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.640660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.642352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d823e9d31401459cbf02d9360e9c8e1f) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:36.643251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:36.646486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:36.657662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 351/688] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/role_assignments?user.id=d823e9d31401459cbf02d9360e9c8e1f&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:36.659805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.666935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:36.787022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b190d83-ec96-4f9b-a141-58b44461344a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.818311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:36.891915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.892973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.893450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.893983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.895380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:36.895966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:36.898602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281018f-9ee7-462d-befb-42fb5da2ab99 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:36.913395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f352f2d-3d6d-4138-a905-a1aa410d34c0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:36.916157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 338/689] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:36.918470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581c52-d93d-425b-abef-5b8c3d321124 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.919019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581c52-d93d-425b-abef-5b8c3d321124 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.919575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08581c52-d93d-425b-abef-5b8c3d321124 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:36.922429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 339/690] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:36.923975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08581c52-d93d-425b-abef-5b8c3d321124 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:36.980581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:36.981759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:36.982230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:36.982735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.007982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.010959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1668239e-1071-496b-9da7-52a92405e1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:37.041896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:37.043615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:37.046064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:37.046064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.046064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:37.046064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 352/691] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:37.046540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.047018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.048158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.075915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08581c52-d93d-425b-abef-5b8c3d321124 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.082163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:37.084554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:37.123620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.126588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.126924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.127259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.144691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.147354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:37.166108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:37.167223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:37.168203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:37.168203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.168203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:37.170751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 340/692] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:37.171962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.191651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:37.200956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:37.238449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 353/693] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:37.238449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.369540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330911e4-23a0-470b-9fa1-f5834e7fa914 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.442471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.443188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.443565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.443843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.445045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:37.445045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.446268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.469464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add41ed4-172c-4a23-94bf-a40503ed9a6d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.476811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 341/694] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:37.486450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.545833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.546484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.546777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.547043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.547702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:37.548006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.549403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.579475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 354/695] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:37.580793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.628121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:37.653369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d86ec-0dc7-445b-87db-e0c4c6412b32 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.714818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:37.717342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.718976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.719742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.720476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.735008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.737830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.755339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f1f3-b449-4b29-b521-0242ae58d855 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:37.762552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:37.764364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:37.766159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:37.771519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 342/696] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:37.773964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.815144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.816333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.816622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.816899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:37.832480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:37.833969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:37.854118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:37.855504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:37.857161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:37.857161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:37.857161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:37.860913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 355/697] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:37.861946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:37.950196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ae70d-c30b-4608-9b54-14be76a055cb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:37.996719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:37.997356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:37.997625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:37.997898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.008497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.010214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.014032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:38.015151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:38.021621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45848739-0050-4cec-97de-08e3ea6b3b33 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:38.029291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:38.030878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 343/698] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:38.032134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:38.070779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.071903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.072466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.072955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.074444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:38.075002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.077110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.094747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 356/699] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:38.096528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:38.162069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289879-7e03-41b1-a48c-0f62e03f5b2f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.202220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.203287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.203786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.204281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.205145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:38.205663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.207958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.229671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 344/700] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:38.231079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:38.299877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf706a3-8351-4bd5-a45f-8d2a778b974e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.318535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:38.366712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.367183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.367879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.368339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.369697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:38.370294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.372770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.399959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d6d0c-2741-4326-b0ab-f1a84389fdc3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.407786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 357/701] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:38.409163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:38.433567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:38.471856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.474179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.474954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.475682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.477272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=894ed64582f5481f8e5c5c70bb901e0b) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:38.478233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.481630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.494821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 345/702] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:38 2022] GET /identity/v3/role_assignments?user.id=894ed64582f5481f8e5c5c70bb901e0b&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:38.496469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:38.553925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d746-df30-487d-a651-aa07f6341633 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.621142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.622277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.622798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.623204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.624423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.627424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:38.664408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 358/703] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:52:38 2022] POST /identity/v3/users => generated 254 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:38.715964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b876c96-8e95-4ed7-96b6-f4d7b35c084e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:38.765655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:38.788185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:38.789355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:38.789939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:38.790551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:38.906597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:38.908138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc3f85-725d-47bd-838c-ce6a38ac2815 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:39.047280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 346/704] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:39.053557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:39.202820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:39.271090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0b65-a870-40f4-86af-05a79a3f7939 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:39.279893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01467eac-e29e-445e-afd1-da076aabe85b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.280533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01467eac-e29e-445e-afd1-da076aabe85b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.281061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01467eac-e29e-445e-afd1-da076aabe85b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.283208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 347/705] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:39.289380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631771-9c92-453e-a18a-40d9b7b05180 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.289717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631771-9c92-453e-a18a-40d9b7b05180 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.292579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631771-9c92-453e-a18a-40d9b7b05180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.324108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:39.324642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.324919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.325199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.339466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8f631771-9c92-453e-a18a-40d9b7b05180 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:39.340701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8f631771-9c92-453e-a18a-40d9b7b05180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:39.355479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:39.357107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:39.376059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:39.391259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:39.392292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:39.393186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:39.393186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:39.393186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:39.393887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 359/706] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:39.399230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:39.486901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:39.488858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359255-a14b-4f4f-80f2-5a02d7ea3967 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.489153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359255-a14b-4f4f-80f2-5a02d7ea3967 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.489430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359255-a14b-4f4f-80f2-5a02d7ea3967 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.495744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 349/708] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:39.501189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.501555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.501905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.527089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:39.528302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:39.616146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 350/709] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:39.635855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660b27-1f4d-4dac-9c03-7a04e5ec91b3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:39.687463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:39.717130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:39.718490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.718978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.719485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.720691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:39.721249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:39.724527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:39.754295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 360/710] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:39.760100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:39.882704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:39.905775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9269-22cd-40b4-bde5-e81c0cec990c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:39.961971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:39.984200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:39.984854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:39.985135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:39.985407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:39.994852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:39.996905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:40.012385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:40.013853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 351/711] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:40.016363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.145032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addcaf-79df-4e3f-bd95-a89cc554d620 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.165237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15999b3-1efd-4582-b21d-674b2996989d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.192398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.193051 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.193355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.193614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.194196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.195608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:40.212814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:40.213959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:40.214871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:40.218403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 352/712] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:40.219584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.225105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596177ef-1456-4278-8558-0078c50282da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.226157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596177ef-1456-4278-8558-0078c50282da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.226943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596177ef-1456-4278-8558-0078c50282da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.227444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596177ef-1456-4278-8558-0078c50282da None admin] PATH_INFO: `/v3/services/network` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.228287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596177ef-1456-4278-8558-0078c50282da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.230098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596177ef-1456-4278-8558-0078c50282da None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.239467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-596177ef-1456-4278-8558-0078c50282da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:40.251190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:40.252322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:40.253737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:40.256891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 361/713] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:39 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:40.258156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596177ef-1456-4278-8558-0078c50282da None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.326776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:40.372861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271500d4-0907-4b0c-98f5-d9db69a32905 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.407943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596177ef-1456-4278-8558-0078c50282da None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.422530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.423626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.424109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.424594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.425952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:40.426558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.429573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.452176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 353/714] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:40.453701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.468137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.468782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.469062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.469337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.470325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:40.470707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.473417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.487737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 362/715] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:40.489240 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.573221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:40.622284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7f04-a21c-44a5-978c-d186e085cd80 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.660678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.661196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.661473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.661737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.662416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] RBAC: Adding query filter params (name=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:40.662715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.664086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.673877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 354/716] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:40.674919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.690861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7183f-537c-42e4-ab44-ae889a8b3872 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.720873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:40.759684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.760680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.761352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.762056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.763867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:40.764658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.767830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.779747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 363/717] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:40.781268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:40.788050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed715-0bab-42c7-ab28-c48c3db2c29a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:40.823931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:40.835863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dcf54-5279-4257-9328-113882e7550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:40.836935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dcf54-5279-4257-9328-113882e7550f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:40.837420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dcf54-5279-4257-9328-113882e7550f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:40.837886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dcf54-5279-4257-9328-113882e7550f None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:40.839094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dcf54-5279-4257-9328-113882e7550f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:40.839823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dcf54-5279-4257-9328-113882e7550f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:40.842892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dcf54-5279-4257-9328-113882e7550f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:40.856482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 355/718] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:41.002568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d572d7-bf26-423f-ab94-cc0cb27bf9fe None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:41.052695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:41.053633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:41.053985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:41.054290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:41.055123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:41.055632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:41.057165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b7fa-357a-4d65-9973-d89a025ec8f5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:41.066112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 364/719] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:41.569195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8236d5-2739-4b46-8f24-29cebb6df7ea None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:41.569626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8236d5-2739-4b46-8f24-29cebb6df7ea None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:41.569809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8236d5-2739-4b46-8f24-29cebb6df7ea None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:41.571561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 356/720] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:41.585215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:41.585739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:41.585739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:41.612170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:41.613953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:41.615072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e250c-3b7a-4990-b878-290cf1c7fab8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:41.615575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e250c-3b7a-4990-b878-290cf1c7fab8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:41.615939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e250c-3b7a-4990-b878-290cf1c7fab8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:41.618697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 357/721] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:41.627909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:41.628401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:41.628893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:41.662429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:41.664500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:41.682762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:41.781305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 365/722] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:41.800151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 358/723] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 09:52:42.172347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:42.331617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:42.422581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4c81e-23b7-4d9f-9d43-0248889ce752 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:42.488544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:42.489757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:42.490299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:42.490804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:42.504214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:42.509596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:42.510690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:42.511562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:42.515313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 366/724] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:42.521739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:42.566080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865909a-a17f-42c0-b802-5482b7c83a35 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:42.594013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:42.634988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:42.667671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:42.668333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:42.668614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:42.668889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:42.708726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59ba86-6a8a-4487-9099-e2440535f313 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:42.729508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:42.734517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:42.736734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:42.739502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:42.741513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 359/725] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:42.742693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:42.752328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:42.753951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:42.754343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:42.754695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:42.758988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:42.759383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:42.760878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:42.776461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 367/726] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:42.783610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:42.985707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604062-6268-4805-b011-33683c9cadb6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.046660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:43.047171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.049676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.050162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.050656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.051848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:43.052413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.054765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.076684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c9b47-749f-460f-a9cc-ee3ed3c76fea None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.088305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 360/727] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:43.095422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.178807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:43.223037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.223817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.224223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.224561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.232557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51976-3f17-4552-9462-56b34ca0291a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.265386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.266807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.273929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.274608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.274890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.275167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.286998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.288494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:43.304433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:43.306324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:43.308120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:43.308120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:43.308120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:43.308120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 361/728] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:43.308578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:43.311263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:43.314699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:43.314699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:43.314699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:43.314699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 368/729] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:43.317808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.322512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.490726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c996-300d-466e-9da8-70d9855d9dd5 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.527615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.528067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.528332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.528682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.529261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:43.529554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.531058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.544276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 369/730] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:43.549842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.554820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:43.652233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:43.663196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135af35-3e15-4fb3-9f88-156d3f863c38 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.666455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ab21-f699-4fcc-a56f-6325a9de8773 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:43.721575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.722551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.723010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.723428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.746272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.748262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.750018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:43.751342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:43.752308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:43.752715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:43.754593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:43.755231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:43.766269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:43.772260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:43.773390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:43.774529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:43.776829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 370/731] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:43.782817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.783472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 362/732] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:43.796327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:43.866791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:43.955634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce148a9-fe93-40e3-8b9e-43a1f4eff9c2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:44.031001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:44.031626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.032244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.032538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.033366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:44.033620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:44.035770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:44.049111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f3d21-87d1-4230-a532-7c37fe3d96d9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:44.082470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 371/733] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:44.086808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:44.114551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:44.115422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.115714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.116663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.125787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:44.127331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-87034899-8c1b-4f6a-b51a-6fc7a3028ba8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:44.142301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:44.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 363/734] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:52:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345745-fd3e-4e95-97b3-57e353ca4532 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.147920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345745-fd3e-4e95-97b3-57e353ca4532 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.150209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345745-fd3e-4e95-97b3-57e353ca4532 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.152346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 364/735] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:44.153457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a431fd-ee34-42c4-b250-24dea21fc503 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.153660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a431fd-ee34-42c4-b250-24dea21fc503 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.153921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a431fd-ee34-42c4-b250-24dea21fc503 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.162222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 365/736] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:44.162222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a431fd-ee34-42c4-b250-24dea21fc503 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:44.186284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:44.235206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a72fe6-17bd-41b9-800e-6d32dc14693d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:44.272922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:44.291805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:44.292462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.292903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.293346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.320250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a431fd-ee34-42c4-b250-24dea21fc503 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:44.376525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:44.377498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.377948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.378967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.379480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:44.379977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:44.382506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b52b-75b0-4cbb-946d-c0fb5ddc6017 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:44.405042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:44.407366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:44.417382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 366/737] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:44.417382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959fee-770c-4c37-838c-8705159d7992 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.417382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959fee-770c-4c37-838c-8705159d7992 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.417382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959fee-770c-4c37-838c-8705159d7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.444113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2c959fee-770c-4c37-838c-8705159d7992 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:44.445966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2c959fee-770c-4c37-838c-8705159d7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:44.553573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 367/738] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:44.556385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.557184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.557960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:44.575996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 372/739] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:44.577495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:44.589681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:44.592387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:44.597830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:44.639208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:44.744868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 368/740] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:44.752660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:44.827146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90670e-208f-46f7-8e20-3257305d026a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:44.904715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:44.907195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:44.908021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:44.909143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.003205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dcd6d-2e89-4a06-ba54-a7a15721c090 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.039673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.041703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.052345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.053201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.053338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.053682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.064606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.067458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.069508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.072346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-77f7a7d6-1d51-4579-a36f-c49d20d5e484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:45.091021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:45.092020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:45.093172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:45.093172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:45.093172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:45.097431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 369/741] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:45.098871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836dbf-0d68-4f6d-980c-6e14b5cd9701 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.099155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836dbf-0d68-4f6d-980c-6e14b5cd9701 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.099429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836dbf-0d68-4f6d-980c-6e14b5cd9701 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.101060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 370/742] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:45.101801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836dbf-0d68-4f6d-980c-6e14b5cd9701 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.179328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 373/743] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 09:52:45.180213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.260500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836dbf-0d68-4f6d-980c-6e14b5cd9701 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.286590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7621131-3124-4c23-9321-0f0cc0a508cf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.311327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.321295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.322412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.322908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.323396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.325624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.326234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.326592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.326870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.327512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:45.327812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.329230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185591b2-d4a8-4e65-a991-7678ed48de5b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.342005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 374/744] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:45.343478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.343756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.344037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.345861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:45.356308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:45.358112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:45.359683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 371/745] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:45.360993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.366534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:45.367751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:45.442604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 375/746] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 09:52:45.443502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.448877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.519045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f9d18-2871-4599-a83f-42afa3553b20 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.569797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.570733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.571145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.571547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.572340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.572500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357a3a2-fe16-415d-8f8a-5ca2ab4acbc9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.574179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.588498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.602627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 372/747] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:52:45 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:45.602627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.653305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.654996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.655455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.655909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.677043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.680133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:45.715824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:45.717981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:45.719766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:45.719766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:45.719766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:45.723793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 376/748] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:45.725565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.821096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a87-a78e-4949-a076-3548cb592df6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.842435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:45.873073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.873963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.874455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.874892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.883951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.885428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.903455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0687aa5-f4fe-438e-8da6-53cd8ea544b7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:45.906364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:45.907783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:45.908696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:45.911847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 373/749] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:45.912982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:45.961675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:45.962597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:45.963050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:45.963490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:45.964537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:45.965333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:45.967150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:45.986580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 377/750] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:45.986580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.024223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:46.084694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eabe5-40b3-4aa2-8301-36ea25c9573b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.132067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.132794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.133132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.133493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.134228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:46.134650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.136118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.154307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 374/751] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:46.154307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.173079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229ee82-c5da-4e44-972f-a2900c4060c7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.190151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:46.243411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.244460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.244962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.245461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.246705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.249327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.277592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 378/752] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:52:45 2022] POST /identity/v3/services => generated 240 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:52:46.277592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.310622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1916a3-8d20-4380-9e43-1af95b9c2531 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.371089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.372007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.372436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.372858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.373868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:46.374382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.376155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.398806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 375/753] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:46.400314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.443504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:46.482445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6977-49ba-4af5-b738-ae957d8efeb9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.527215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:46.547178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.548217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.548733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.549191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.552582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8078-6dc0-45d8-9641-59ace8ff209f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.569644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.571898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:46.592978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:46.594038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:46.594968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:46.594968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:46.594968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:46.594968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 379/754] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:46.595190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.617012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.618402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.618402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.618402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.628377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.629100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:46.652288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:46.654014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 376/755] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:46.658358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.752756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24da1-8d2d-4635-86c6-4e0d8c85f640 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.819672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.820610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.821044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.821478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.822474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=894ed64582f5481f8e5c5c70bb901e0b) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:46.822988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.824800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.831970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:46.847570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 380/756] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/role_assignments?user.id=894ed64582f5481f8e5c5c70bb901e0b&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:46.848992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:46.869156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a669-83ef-4230-8b87-bfaf9aff3a60 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:46.962371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:46.963461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:46.963981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:46.964483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:46.965390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:46.965929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:46.967937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:46.985586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 377/757] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:46.992507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:47.002829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:47.148094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8e52-7168-4cc4-a977-462e8ae45467 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:47.250396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4704f-c5a9-4584-a1ba-ab5344b6db03 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:47.261115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:47.262767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:47.263710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:47.264550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:47.266201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:47.267159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:47.270943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:47.292398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 381/758] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:47.298730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:47.308634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:47.310173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:47.310532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:47.310859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:47.323570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:47.327488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:47.357439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:47.358586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:47.359543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:47.360094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 378/759] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:47.370348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:47.423781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:47.519248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:47.556777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0e040-1280-4c71-9fec-0e3e37e6551c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:47.602483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4db3-f1a4-4a7c-b0a6-e9461962fcdf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:47.640906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:47.641525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:47.641804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:47.642084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:47.642836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d17d0df9842d415fa8512364e47532c0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:47.643140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:47.645146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:47.663182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 382/760] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:47 2022] GET /identity/v3/role_assignments?user.id=d17d0df9842d415fa8512364e47532c0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:47.678272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:47.678272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:47.678272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:47.678272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:47.678730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:47.678730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:47.679067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:47.702299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 379/761] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:47.719110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:47.915815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610979a1-d209-4468-bf10-666b35bbb770 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:47.943724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:47.963420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:47.964068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:47.964346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:47.964614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:47.985384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:47.988700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:48.021351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:48.022404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:48.023306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:48.023306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:48.023306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:48.032397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:48.036920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 383/762] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:48.270988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af5641-2a7a-44cf-bb3d-887aa69d3323 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:48.309103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:48.322410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:48.323048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:48.323326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:48.323600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:48.324257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:48.324564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:48.325964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:48.343156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 380/763] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:48.356049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:48.639870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc76cc-3de7-4049-9975-b7a9bfa932f9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:48.741012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:48.742113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:48.742651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:48.743224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:48.764155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:48.766981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:48.790432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:48.791398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:48.792305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:48.793232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 384/764] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:48.801736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:48.961609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00516ad-b1f6-41b7-8b03-96d2e5a09148 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:49.022012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:49.022706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.022988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.023264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.024041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:49.024319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:49.025791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e4ba-8e65-4a62-82a5-06df4b58e2cc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:49.040356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 381/765] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:49.050201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:49.129164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f60e3-7cd3-421e-9a92-24c740a62ca2 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.129646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f60e3-7cd3-421e-9a92-24c740a62ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.130067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f60e3-7cd3-421e-9a92-24c740a62ca2 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.133149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 382/766] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:49.138563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0736a-d87a-4765-8dba-d36b69a9da0b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.138974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0736a-d87a-4765-8dba-d36b69a9da0b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.139375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0736a-d87a-4765-8dba-d36b69a9da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.161446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-afe0736a-d87a-4765-8dba-d36b69a9da0b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:49.162740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-afe0736a-d87a-4765-8dba-d36b69a9da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:49.167022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:49.239954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:49.255462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66b6e9-e7ba-40e8-9261-8c4c6fdb3d8f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:49.298116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:49.298873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.299159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.299431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.301435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=3be328584a6549aeb096ab9b852daf9d, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:49.303011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703c64b-c1dd-454f-8d25-7d628e24d979 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:49.304636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 383/767] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:49.308177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5098e93-7931-443d-b1c2-fcaadccc46c5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.308688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5098e93-7931-443d-b1c2-fcaadccc46c5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.309225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5098e93-7931-443d-b1c2-fcaadccc46c5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.318479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 384/768] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:49.319443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd865c-7f3d-4cbe-8986-dc904fb2accf None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.320014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd865c-7f3d-4cbe-8986-dc904fb2accf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.320505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd865c-7f3d-4cbe-8986-dc904fb2accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.341738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 385/769] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:49 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:49.364159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-81cd865c-7f3d-4cbe-8986-dc904fb2accf None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:49.370445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-81cd865c-7f3d-4cbe-8986-dc904fb2accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:49.527190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 385/770] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:49.562469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b589ef-2681-41c0-8732-053139bd3219 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.563409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b589ef-2681-41c0-8732-053139bd3219 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.563873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b589ef-2681-41c0-8732-053139bd3219 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.565982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 386/771] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:52:49.573341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.573837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.574363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.583533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b589ef-2681-41c0-8732-053139bd3219 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:49.608836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:49.610798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:49.787498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 386/772] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:49.828536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:49.837982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b589ef-2681-41c0-8732-053139bd3219 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:49.866631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:49.890013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:49.891132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:49.891642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:49.892108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] PATH_INFO: `/v3/services/network` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:49.892921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:49.894637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:49.904539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:49.905629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:49.906495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:49.908548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:49.914807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 387/773] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:49 2022] GET /identity/v3/services/network => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:49.920055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:49.992696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580ddcc-4c6f-453e-a9ad-391103461991 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.031955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.032992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.033481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.033969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.038634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.041112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:50.055251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:50.056320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:50.057168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:50.064217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 387/774] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 21 09:52:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:50.066720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.114734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1b4c-bc96-44bf-8d53-6f1fa58e164c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.168017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.168740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.169025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.169397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.170055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] RBAC: Adding query filter params (name=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.170397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.171799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.177595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 388/775] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:50.178497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.185812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.190212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2aa5-1977-411c-b085-c9c48044c8e5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.209034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.234108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.235250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.235463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.235773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.236458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.237129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.238846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.244636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 388/776] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:50.245495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.302194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c563d-3bb0-4262-94d2-c9e0232d0395 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.345714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.347566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.347850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.348127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.367666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:50.373837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf22b3-cb81-44da-93cc-55ac8dbec897 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:50.377439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:50.378470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:50.379420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:50.382142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 389/777] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:50.384023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.419986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.421036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.421515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.421982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.422902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] RBAC: Adding query filter params (type=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.423431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.426296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.433512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 389/778] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:50.435157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.473124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.480764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.502755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dae2-a94a-4b33-9da2-f1924d8700e9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.545387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.546201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.546620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.547025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.547798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.548291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.549834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.560957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:50.562060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.574277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c2e1-9a7f-4ff8-9c55-79df76eb8061 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.624231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.625176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.625601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.626018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.627590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.628597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.630706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.643980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:50.645426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.690947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d03c-1ba0-4cb7-880a-4301417a452a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.742972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.743604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.743888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.744166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.744887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] RBAC: Adding query filter params (interface=public, service_id=038481a3cb9b42aa8ae4e318259a23e5, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.745202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.746745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.755409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/endpoints?service_id=038481a3cb9b42aa8ae4e318259a23e5&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:50.756368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.770790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.780756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:50.799538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570e76-5380-4fa3-8400-c0c5c40ae7e5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.840698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.841250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.841716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.842006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.843045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] RBAC: Adding query filter params (interface=public, service_id=0e967894465b4fe0a9027c2968d8c58d, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:50.843502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.844952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.858811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 391/782] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/endpoints?service_id=0e967894465b4fe0a9027c2968d8c58d&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:50.859843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:50.899141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee008-94c6-4c91-82d1-ef2458126f25 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:50.946770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:50.948044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:50.949055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:50.949803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:50.965215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:50.966843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:50.982894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:50.984471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:50.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:50.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:50.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:50.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 392/783] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:50.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:51.013967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46dc8-0f4e-4b7d-aed0-620a45caa950 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:51.059901 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:51.070072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156480-17c1-4167-b9df-852472915b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:51.071305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156480-17c1-4167-b9df-852472915b9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.071769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156480-17c1-4167-b9df-852472915b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.072201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156480-17c1-4167-b9df-852472915b9d None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.073347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156480-17c1-4167-b9df-852472915b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:51.076852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156480-17c1-4167-b9df-852472915b9d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:51.090297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 392/784] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:51.090297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1227-405e-4eca-b5a7-91381486c7bb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.090297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1227-405e-4eca-b5a7-91381486c7bb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.090297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1227-405e-4eca-b5a7-91381486c7bb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.090297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 393/785] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:51.094849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1227-405e-4eca-b5a7-91381486c7bb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:51.124711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091f7d-f4be-48d5-a78d-34f88da8c115 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:51.139341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:51.177082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:51.177731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.178013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.178346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.178992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:51.180495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e090ec-a5e2-492e-9489-3489acf9b825 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:51.187944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 393/786] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:52:50 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:51.189937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.190362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.191113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.224455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:51.226697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:51.387998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1227-405e-4eca-b5a7-91381486c7bb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:51.435889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 394/787] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:51.443116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:51.443758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.444036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.444307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.444958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:51.445258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:51.450319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:51.579311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 394/788] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:51.585777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:51.668313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:51.743861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8ea3f-3944-46eb-9fad-83990f7789ea None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:51.757148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:51.783467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:51.784668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.785011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.785286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.793934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:51.795436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:51.822056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:51.823894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:51.825686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:51.828299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 395/789] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:51.834274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:51.901704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:51.932009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871198-df25-477b-9d5e-e60c65b54599 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:51.974526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:51.975850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:51.976138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:51.976422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:51.989730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:51.995341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:51.997187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:51.998839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 395/790] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:52.004480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:52.160720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785851e-be2c-4c35-af4e-3e4af0e23799 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:52.198597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:52.247671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:52.248318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:52.248610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:52.248886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:52.249684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:52.250014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:52.251561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:52.271357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f3e8-aa7b-4e6d-bf2d-16416ca36e60 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:52.298601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 396/791] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:52.316628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:52.353782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:52.354445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:52.357619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:52.357619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:52.358315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:52.358566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:52.359934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:52.368530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:52.379694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 396/792] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:52.384493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:52.578885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f8735-5a04-47ea-999a-47baee5d5290 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:52.694277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f836-0ba4-4d91-8d63-706405200979 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:52.775239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:52.776066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:52.776204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:52.776557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:52.793499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:52.794865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:52.795176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:52.795431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:52.817634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:52.820724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:52.827295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:52.828833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:52.858043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:52.859832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:52.861400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:52.861400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:52.861400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:52.861400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 397/793] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:52.868495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:52.880207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:52.881904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:52.884246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:52.884246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:52.884246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:52.890798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 397/794] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 574 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:52.899484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:52.984292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.003293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.081471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e90b1d-b34e-46b0-bae9-87d19115ec8e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.120987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.121505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.121779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.122056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.122747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:53.123051 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.124440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea27a9e-8711-4131-b181-1ccce53ac15c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.142412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 398/795] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:53.144608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a3f5-0d23-4642-a045-119a298c233b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.144888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a3f5-0d23-4642-a045-119a298c233b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.145163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3a3f5-0d23-4642-a045-119a298c233b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.153399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 399/796] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:53.153399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3a3f5-0d23-4642-a045-119a298c233b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.159850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0dde-6d15-4a49-b17d-41d649101adf None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.224442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.225999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.226849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.227625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.229177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:53.230031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.232734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c28acb-2cf9-4bd4-b813-48df3462c48e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.256980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 398/797] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:53.259698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769e19-549d-4545-82dd-106a53117f08 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.260489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769e19-549d-4545-82dd-106a53117f08 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.261295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769e19-549d-4545-82dd-106a53117f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.264909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3a3f5-0d23-4642-a045-119a298c233b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.276830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.294761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-76769e19-549d-4545-82dd-106a53117f08 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:53.297274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-76769e19-549d-4545-82dd-106a53117f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:53.304768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.305422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.305706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.305983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.314484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.316618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:53.329339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:53.331150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:53.332606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:53.335253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 400/798] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:53.336240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.434283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 399/799] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:53.435693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769e19-549d-4545-82dd-106a53117f08 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.459736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dc33-aac2-4499-9f99-292449b915b3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.473841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.502135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.503999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.503999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.503999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.512015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.513508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:53.527343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:53.528322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:53.529220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 401/800] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:53.546271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.576371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.642282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769e19-549d-4545-82dd-106a53117f08 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.662295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec575d-6a39-456f-aabe-9d3634df1d94 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.697668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.698323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.698533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.699003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.704742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:53.704742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.704742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.716704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 402/801] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:53.718453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.719298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.719726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.720161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.721072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:53.721574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.723210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.734323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.784521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 400/802] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:53.796205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:53.906843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.924334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2ff24-7fdb-4b60-acb9-6b7054be8a77 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.948564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:53.968314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:53.969316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:53.969781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:53.970220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/894ed64582f5481f8e5c5c70bb901e0b/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:53.972909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=894ed64582f5481f8e5c5c70bb901e0b, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:53.974731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:53.978531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecaca-a188-4e55-aa38-cc0e3661e2f0 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:53.992152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 403/803] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:53 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/894ed64582f5481f8e5c5c70bb901e0b/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:53.993447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.019552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.020212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.020504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.020770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.033299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.035299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:54.059917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:54.061141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:54.062110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:54.062110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:54.062110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:54.075346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 401/804] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:54.087243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.135059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77b49-5c11-4251-b184-279bc051c071 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.176938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.177841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.178321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.178741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.191692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:54.197480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:54.198622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:54.199624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:54.202050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 404/805] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:54.223442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.247306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.262766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef6c8-7dc7-41f7-918d-53dbd04a66d7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.298702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.311639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.312607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.314014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.314737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.316526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:54.318284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.319966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.339013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 402/806] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:54.353968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.428880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f369049-09d7-4798-bf98-5cd6fd2c9045 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.473028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.473573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.473857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.474133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.475018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:54.475332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.476848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.487781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 405/807] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:54.494698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.510453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1150c5-2f5b-41e0-9318-f5c911396d52 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.570287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.571181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.571596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.572016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.579496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.581253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-9d6e9582-9084-43c3-8d13-fb6d0e5f6ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:54.593825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:54.595064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:54.595976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:54.597033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.598769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 403/808] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:54.600227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d349217-b4e4-41bb-bda6-9d748c644445 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.600660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d349217-b4e4-41bb-bda6-9d748c644445 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.601060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d349217-b4e4-41bb-bda6-9d748c644445 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.602776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 404/809] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:54.612881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d349217-b4e4-41bb-bda6-9d748c644445 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.654941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a841-336f-4571-8a0e-fa2dc11d239f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.666189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.723460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.724675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.725123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.725546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.740696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.742310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.748442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d349217-b4e4-41bb-bda6-9d748c644445 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-638c9789-5518-4c2c-a95f-7268e59eb130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:54.758486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:54.759701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:54.760802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:54.760802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:54.760802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:54.766272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:54.767707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.768074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.768961 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.788884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:54.790387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:54.791577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.792700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.793136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.793576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.794476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:54.794930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.796558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.809717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 405/811] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:54.811004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.878686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 407/812] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:52:54.879757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:54.923892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcac10f-fbda-4dc5-be68-f5fa72441935 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:54.932103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.963791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:54.964705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:54.965128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:54.965541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:54.966364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:54.966824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:54.968599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:54.986367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:54.986547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 406/813] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:54.988554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.040999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a075-9e4c-41fb-9ea0-25b3e73ab604 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.079909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.081080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.081568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.082097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d17d0df9842d415fa8512364e47532c0/roles/2e8b89a267e94b36953f502498800222` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.100192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=d17d0df9842d415fa8512364e47532c0, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:55.102056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:55.125923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 408/814] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:52:54 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d17d0df9842d415fa8512364e47532c0/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:52:55.227357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.235907 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc417da-9eb9-4453-a1ab-3fe5a61666da None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.293726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.293946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.294274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.294546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.303527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:55.304717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:55.317921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:55.319047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:52:55.320010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:55.322387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 407/815] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:52:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:55.325417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.358390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:55.371839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fae21-1a79-4fca-9170-413c484b8ed2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.394503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:55.446293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.447198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.447611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.447882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] PATH_INFO: `/v3/services/network` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.448487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:55.450029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:55.461525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:55.463555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:55.465141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:55 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:55.475663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.506985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd25d-026e-4464-9f0e-c59199aef5f6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.545699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.546227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.546532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.546807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.547641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:55.548018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:55.549457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999231df-d0ba-47fe-8fc1-422c95cf7380 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:55.575196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 408/817] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:52:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:55.576551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479bdf-9a8b-4a62-b0ec-1c2a2b879a47 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.576837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479bdf-9a8b-4a62-b0ec-1c2a2b879a47 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.577202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479bdf-9a8b-4a62-b0ec-1c2a2b879a47 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.578837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 409/818] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:52:55.584699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.585108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.585355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.628645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0785-5cb1-4f6e-99b6-1454f4229548 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.676031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.676688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.676969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.677243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:55.677906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] RBAC: Adding query filter params (name=network) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:55.678217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:55.679689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:55.685742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 410/819] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:55.686691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.747283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:55.772522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:55.775086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:55.890816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959c65e-337d-4ca4-a4f1-cf1efc433480 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:55.926757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:52:55.928305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:55.979176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:55.991079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:55.992000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:55.992643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:55.993270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:56.225797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7fe3-3587-426f-96c4-1dc5b17a1b64 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:56.227968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:56.229773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:56.314624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:56.314881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:56.315355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:56.315846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:56.316383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:56.317566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] RBAC: Adding query filter params (type=network) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:56.318111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:56.322637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:56.349531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 411/821] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:52:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:56.366880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:56.476470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 411/822] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:52:56.481926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:56.540703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:56.587432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46fcb2-3013-4a9b-9218-b4ce466f9328 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:56.620450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e6a6-6b4c-41bb-a59a-47583a667ab8 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:56.656226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:56.662006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:56.662350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:56.662986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:56.663579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:56.664312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:56.665194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:56.665375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:56.666272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:56.666974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:56.667500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:56.669102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:56.672493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:56.677780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:56.680034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:56.688084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 412/823] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Sep 21 09:52:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:56.689698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:56.744297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 412/824] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:52:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:52:56.746603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:56.954646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c7cc-9cd2-4aff-bc45-88fbadce3eab None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.043018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded516-41c4-4355-a0f4-63479a468b1d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.054956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.056528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.057292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.058075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.082919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:57.087643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.091029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.093529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.094188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.094497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.094769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.095416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:57.095719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.098064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.107535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 413/825] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:57.113767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:57.119297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:57.121503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:57.123498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:57.123498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:57.123498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:57.123498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 413/826] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:57.126659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:57.184876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:57.272607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806b553-4b7d-4b0b-b4df-5ac3216f0088 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.321782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.323678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.325132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.326320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.327972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:57.328822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.332531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.337755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb659-0b45-4d6e-97bb-7000ab787c90 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.357217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 414/827] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:57.367927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:57.384741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.385376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.385659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.385932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.386610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:57.386917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.388317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.397958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 414/828] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Sep 21 09:52:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:57.406916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:57.531819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:57.607799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b511-e330-41bb-ac57-a16038574db1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.616770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0531e0-6807-40c3-a730-163fc09b7b40 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.638649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:57.655735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.656422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.656931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.657214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.657977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.660493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418b29-54b9-484f-b176-b8a2cab5a6e2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.676235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.677430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.678008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.678747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.693086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 415/829] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:52:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:52:57.694881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.696522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.712099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b50b-756d-4c54-9448-0e332523d400 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.712393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b50b-756d-4c54-9448-0e332523d400 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.712730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b50b-756d-4c54-9448-0e332523d400 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a662608f-cae1-4e11-8532-cf6384899311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:52:57.714169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:57.716144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:52:57.718218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:57.719107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 416/830] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:52:57.719251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 415/831] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:57.726177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b50b-756d-4c54-9448-0e332523d400 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:57.728540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c659-6a0c-4ccf-b5b1-d7f31351f35a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.728872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c659-6a0c-4ccf-b5b1-d7f31351f35a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.729140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c659-6a0c-4ccf-b5b1-d7f31351f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.766709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d561c659-6a0c-4ccf-b5b1-d7f31351f35a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:57.769573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d561c659-6a0c-4ccf-b5b1-d7f31351f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:57.902526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 416/832] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:52:57.910921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b50b-756d-4c54-9448-0e332523d400 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:57.929413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:57.957191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:57.957817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.958099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.958403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.959118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:57.959424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:57.960967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:57.971848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007a32-df49-452d-8937-1e08991180e6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.972376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007a32-df49-452d-8937-1e08991180e6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.972376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007a32-df49-452d-8937-1e08991180e6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.974073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 417/833] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:52:57.976612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 417/834] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:57.979716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:57.980005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:57.980286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:57.987732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.006529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:52:58.008111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:52:58.103901 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32bc4-6d62-400b-8bc0-daa8cd876903 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.111551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 418/835] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:52:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:52:58.149568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.150198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.150541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.150818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.151567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:58.151879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:58.153404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:58.161241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 418/836] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:52:57 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:58.220452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.253112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:58.359723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d06aa-30cc-46a9-aa7b-f943ef94a314 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.398714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.399428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.399710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.399984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.413128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:58.418234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:58.419313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:58.420148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 419/837] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:58.420875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.427676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.495920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:58.528853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:58.555360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b133-4dde-414a-a552-cc453f9f04a4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.617812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.618762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4174208-b100-4800-aa41-6865ba360d46 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.618892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.619393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.619873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.621594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:58.623643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:58.626365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:58.652769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 420/838] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:58.659734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.666555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.667362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.667742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.668116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.682087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:52:58.687806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:58.689020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:52:58.690684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:58.691837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 419/839] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:58.697832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:58.825611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06f22-ec7e-44ff-b1b3-340916d57887 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.903444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.903764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:58.904844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.905021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.905874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.913159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915d261-fba9-40a1-8b87-179672d4c362 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:58.929092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:58.931779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:58.935605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:58.965295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:58.966217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:58.966692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:58.967113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:58.968197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:58.968749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:58.969994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:58.971172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:58.973145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:58.973145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:58.973145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:58.973145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 421/840] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:58.978369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:58.980189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.003938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 420/841] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:59.012367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.163045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1256a-1c91-4307-97e0-85b2bf50e378 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.187648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4c02-3b17-4189-b753-bd6f0c54a6af None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.203205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.204130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.204562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.205013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.224282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.226120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:52:59.245755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:59.246825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:52:59.247711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:52:59.247711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:52:59.247711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:59.249900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 421/842] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:52:59.258865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.270070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.271053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.271528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.271984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.272820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:59.273293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.274923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.287326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:59.304749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 422/843] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:59.310287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.447933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:59.482274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceeba8-69a8-4961-b95d-c92139f4d10d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.541430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ca8e-7296-42f1-8e93-050e87259ead None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.566141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.568526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.569323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.570444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.571979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:59.573174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.577091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.613318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 422/844] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:52:59.619740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.621114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.621594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.622061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.624443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.636686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.639829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:59.666114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:59.668003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:52:59.669861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 423/845] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:59.676929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.765368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:59.816297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cba8a-e79b-4ba5-be09-f2d287e7e606 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.850705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dbd44-e44b-4d3c-b767-f32533ce63cc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:52:59.856484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.858063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.858063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.858063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.867249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.869059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.883726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:52:59.885425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:52:59.887626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:52:59.889457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 423/846] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:52:59.899558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:52:59.927322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:52:59.928984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:52:59.929819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:52:59.930688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:52:59.932592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:52:59.933478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:52:59.936997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:52:59.974996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 424/847] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:52:59.981149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.045045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afae3-e52c-4029-b6f2-db99962a9930 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.101504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:00.112955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:00.114018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:00.114575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:00.115132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:00.116476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:00.117031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:00.119926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:00.134131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a35009-a7e5-4d11-a34a-866f7e981d7d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.160293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:00.164868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.177403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:00.178402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:00.178890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:00.179390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:00.234171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:00.273765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:00.275664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:00.352299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11239-6814-444d-ba68-9a1bb930250f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.391062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:00.392058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:00.392543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:00.393017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:00.444251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 425/849] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:52:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:00.450836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.461695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:00.474846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:00.476498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:00.600525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 425/850] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 09:53:00.604752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.610161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:00.675501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fd9e7-fff7-457f-aec5-0b69c9b3a0e0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.716137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:00.742235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd809e8-42c7-438f-b256-ce6ba0e01573 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.743382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:00.744030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:00.744310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:00.744646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:00.757784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:00.759352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:00.778491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:00.780250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:00.781910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:00.781910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:00.781910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:00.785496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 426/851] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:00.786648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.846226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:00.848697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:00.849826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:00.851419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:00.879592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:00.884529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:00.926805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:00.928617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:00.931108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:00.931108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:00.931108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:00.932854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 426/852] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:00.934645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:00.937146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2e33-8d85-4068-a6cf-571782732b05 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:00.994430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.008394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.009201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.009542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.009891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.010689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:01.011058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.012566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d47a-bf99-491f-9695-c5775b4cb747 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.026440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 427/853] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:01.027856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404af1a-54a7-45c1-8729-5da4b8468b7d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.028211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404af1a-54a7-45c1-8729-5da4b8468b7d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.028572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404af1a-54a7-45c1-8729-5da4b8468b7d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.030291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 428/854] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:01.032199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404af1a-54a7-45c1-8729-5da4b8468b7d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.104587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3043a-0dd8-45a2-a705-14af8857183e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.147345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.147965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.148245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.148645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.149421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:01.149734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.151255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c256-3670-40d1-b9a2-db8b7231e413 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.162535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404af1a-54a7-45c1-8729-5da4b8468b7d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.165697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 427/855] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:01.167119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.167457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.167776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.175154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.193358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:01.194696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:01.220496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.221186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.222010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.222323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.232790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.234606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:01.249918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:01.251832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 429/856] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:01.253606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.324572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.332962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 428/857] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:01.333907 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.423045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0699d-ec43-49ee-a95a-7c9508f1cee2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.470875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.472540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.473010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.473549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.484031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24f26-75a2-47e3-829b-5b4d5718ae7f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.487362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.489948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-46caa8aa-8035-47e8-b0c6-0cb84f190952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:01.513033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:01.513986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:01.514948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:01.515376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 430/858] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:01.517513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addedea-92ad-45d8-8ba9-deb96e7edbe8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.517996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addedea-92ad-45d8-8ba9-deb96e7edbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.518993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addedea-92ad-45d8-8ba9-deb96e7edbe8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.521611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.523647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 431/859] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:01.525019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addedea-92ad-45d8-8ba9-deb96e7edbe8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.527696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.528418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.529143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.529741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.530828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:01.531133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.532591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e138c68-aed2-4611-bc08-a130ee35dcca None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.547788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 429/860] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:01.549594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.550059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.550516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.572265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:01.573513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:01.674936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 430/861] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:01.676261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.700682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addedea-92ad-45d8-8ba9-deb96e7edbe8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.707383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.770484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.771643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.772096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.772614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.773811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:01.774363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.776416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.805933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 432/862] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:01.805933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.864443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e17b8-9a80-430b-8b55-9f08f53ac005 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:01.894326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:01.911570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:01.912475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:01.912932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:01.913386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:01.914448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=894ed64582f5481f8e5c5c70bb901e0b) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:01.914962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:01.917496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:01.928147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 431/863] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/role_assignments?user.id=894ed64582f5481f8e5c5c70bb901e0b&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:01.929555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:01.994168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f199-5c07-445c-8ce7-964905b3d376 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.039505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.040583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.040583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.040844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.041348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.043013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:02.053034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:02.055343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.056679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 433/864] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:02.059195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:02.113021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:02.125883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa6e6-89b5-46c5-91da-fbaf5c3a1618 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.186703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.187679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.187988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.188323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.189579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d17d0df9842d415fa8512364e47532c0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:02.190750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.194021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.205130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 432/865] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:01 2022] GET /identity/v3/role_assignments?user.id=d17d0df9842d415fa8512364e47532c0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:02.206722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:02.243003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133de2-ad2c-445e-9572-a76710e64ae0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.309978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:02.333672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.335580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.336375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.337698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.339660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.342570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:02.364638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:02.366521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:02.376607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 434/866] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 21 09:53:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:02.380392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:02.432820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c3eb-9b01-413a-9e64-6b0cd53f28d4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.500217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.501382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.501868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.504118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.504118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:02.504664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.509007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.519817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 433/867] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:02.528979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:02.530443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:02.540613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600e62-7c83-45f0-bf08-7d70d399c97f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.608189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.609717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.610568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.611367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.613468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:02.614353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.617273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.626796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 435/868] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:02.638589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:02.664147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15baa8d-4e0f-415c-a624-00e70e17c159 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.681637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:02.716673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.718325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.718325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.718325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.718990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:02.719347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.720811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06792c7-e371-46c0-84cb-75fb38434250 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.734285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 434/869] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:02.807993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af32f5-ca05-4207-b464-eaf86346d0eb None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:02.849847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:02.850516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:02.850797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:02.851067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:02.851715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:02.852028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:02.853443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc21d9-bb15-4741-9fd7-bc41d36db734 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:02.859555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 436/870] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:04.463876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef00a-349a-4db2-994e-7bb56ae5a240 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:04.464405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef00a-349a-4db2-994e-7bb56ae5a240 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:04.464405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef00a-349a-4db2-994e-7bb56ae5a240 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:04.466131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 435/871] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:04.472422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880b7a-8ce4-4262-b1e3-9e668299acf2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:04.472927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880b7a-8ce4-4262-b1e3-9e668299acf2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:04.473001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880b7a-8ce4-4262-b1e3-9e668299acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:04.492475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-66880b7a-8ce4-4262-b1e3-9e668299acf2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:04.493715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66880b7a-8ce4-4262-b1e3-9e668299acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:04.514630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:04.576254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 437/872] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:04.637967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54a0a-5e7a-42f3-9355-868b73171cb6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:04.638308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54a0a-5e7a-42f3-9355-868b73171cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:04.638578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54a0a-5e7a-42f3-9355-868b73171cb6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:04.640192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 436/873] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:04.645841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:04.646443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:04.646955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:04.667017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:04.668555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:04.766528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 438/874] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:04.852638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54a0a-5e7a-42f3-9355-868b73171cb6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.033286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54a0a-5e7a-42f3-9355-868b73171cb6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.046270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.073799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.074482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.074764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.075423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.075747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:05.077169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:05.087667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:05.088724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:05.090198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 437/875] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:05.095062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.142396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:05.148510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:05.166855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64dc7-ee01-40f0-b1f4-daa40044919c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.204749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.206480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.206991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.207457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.219544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:05.219971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1d1c5-7858-474a-925b-e9aeddc457cc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:05.225777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:05.226797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:05.227649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:05.235010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 439/876] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:05.236729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.263216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.263467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.263731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.264004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.264656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:05.264964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:05.266400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:05.272639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 438/877] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:05.285266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.369383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81041c9-320d-4761-a1d2-a2b2787a9fa2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.421132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.421761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.422046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.422356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.423043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:05.423352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:05.424898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:05.439421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 440/878] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:05.444656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.446919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4a31-0e16-4927-9578-8f1554021bd7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.460764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:05.463708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:05.504299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.505034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.505337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.505570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.506208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:05.506636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:05.508461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56fe21-61ff-496c-bd9d-083a86036508 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:05.518777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 439/879] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:05.609233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0187b-b763-4371-85eb-55e922d452b7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.653321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:05.654006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.654372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.654654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.662578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1c38-3f95-43fe-8493-25617e7bb1ad None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.663454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1c38-3f95-43fe-8493-25617e7bb1ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.664217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1c38-3f95-43fe-8493-25617e7bb1ad None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.667578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 440/880] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:05.672754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:05.673238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63230-7c20-46cf-97e9-71b590313285 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.673531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63230-7c20-46cf-97e9-71b590313285 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.673809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63230-7c20-46cf-97e9-71b590313285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.676702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:05.696051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7cd63230-7c20-46cf-97e9-71b590313285 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:05.697558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7cd63230-7c20-46cf-97e9-71b590313285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:05.711812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:05.712898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:05.713807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:05.713807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:05.713807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:05.722128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 441/881] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:05.724196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:05.807216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 441/882] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:05.852302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:05.875814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16662a-ae94-4681-b244-74e4da34df36 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.876112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16662a-ae94-4681-b244-74e4da34df36 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.876368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16662a-ae94-4681-b244-74e4da34df36 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.878071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 442/883] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:05.883557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:05.883841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:05.884101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:05.904041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:05.905283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:05.938779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bd4c1-8ca8-4c86-9511-cb117ccf1e30 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:05.986720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 443/884] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:06.005301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.006465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.007023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.007517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:06.008721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:06.009328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:06.012147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:06.041595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 442/885] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:06.046745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:06.084438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:06.104056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:06.202494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d2dc0-08cb-40ee-8ebb-f4902805cad6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:06.254532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.255503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.255931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.256364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:06.271468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:06.274380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:06.280690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef935f-0aeb-4614-b61e-659b3b04dcee None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:06.298118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:06.299178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:06.300189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:06.300728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 444/886] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:53:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:06.302071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:06.314546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:06.353034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.354070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.354611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.355097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:06.356301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:06.358820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:06.392832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 443/887] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:06 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:06.401253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:06.434650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:06.449782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25272-7007-4deb-b291-2b7d95e05cda None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:06.518833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.520421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.520897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.521385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:06.522304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:06.524125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:06.550932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 445/888] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:06 2022] POST /identity/v3/services => generated 269 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:53:06.631928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba1e59-6167-499f-a76f-e6a7179a0fb6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:06.720915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.722548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.723284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.724028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:06.725753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:06.726585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:06.729665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:06.768578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 444/889] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:53:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:06.777342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:06.910666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef33e-5f8a-4462-b344-e26ccce7a9ff None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:06.976809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:06.977859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:06.978372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:06.978868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:07.011377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:07.100811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:07.103389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:07.272437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 446/890] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:06 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:07.279473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:07.313065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:07.443621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483dd2-25b4-4ff8-84bb-4b9e0fb472f4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:07.507388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:07.508491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:07.508969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:07.509446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:07.528968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:07.531840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:07.560529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:07.562527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:07.564408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:07.564408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:07.564408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:07.570446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 445/891] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:07.573050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:07.676782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:07.764444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e059-0c65-4584-a257-fadbe744517d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:07.808611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:07.809260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:07.809547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:07.809825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:07.810539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:07.810849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:07.812290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09a3a7-061d-4925-a852-3276625b1aa6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:07.828161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 447/892] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:07.837845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:07.917793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181e2-8c65-41d1-9d97-86e4117d6aea None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:07.918072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181e2-8c65-41d1-9d97-86e4117d6aea None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:07.918404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181e2-8c65-41d1-9d97-86e4117d6aea None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:07.920027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 448/893] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:07.926723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:07.926993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:07.927267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:07.947384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:07.948622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:07.978325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:08.003459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7a04-579b-4f93-b7a2-9908e92e0079 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:08.046777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 449/894] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:08.057833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:08.059074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:08.059707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:08.060232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:08.071457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:08.073655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:08.092988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:08.094871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:08.097274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:08.106436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 446/895] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:08.112437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:08.179948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:08.301307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bd50-752a-4457-b31c-e8e195423d93 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:08.342031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:08.362905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:08.364318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:08.365031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:08.365675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:08.367278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:08.368042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:08.371066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:08.398350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 450/896] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:08.402952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:08.488536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98677753-6000-4515-9f87-3eab74c3d2ac None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:08.549873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:08.550991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:08.551631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:08.552369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:08.554000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:08.556522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44427f50-3109-4652-9411-f0a25cc1b0b1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:08.575104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:08.586032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:08.594890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 447/897] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:08 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:08.606720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174c74-7c63-4e18-9853-779397213066 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:08.678503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:08.680338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:08.681202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:08.682022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:08.683829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] RBAC: Adding query filter params (role.id=70e90ac265df47088a469f9e537e12d2, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d17d0df9842d415fa8512364e47532c0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:08.684669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:08.686966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d70ee-e87c-45da-b7b2-76c3d971802d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:08.703794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 451/898] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:08 2022] GET /identity/v3/role_assignments?user.id=d17d0df9842d415fa8512364e47532c0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=70e90ac265df47088a469f9e537e12d2 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:09.100191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1805-6ece-4cbb-ad59-e0c556cb61ad None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:09.100744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1805-6ece-4cbb-ad59-e0c556cb61ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:09.100744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1805-6ece-4cbb-ad59-e0c556cb61ad None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:09.102623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 448/899] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:09.108628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:09.108988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:09.109191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:09.137518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:09.139448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:09.244569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ad8-45a6-4997-9a3c-55eca0c5003c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:09.244949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ad8-45a6-4997-9a3c-55eca0c5003c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:09.245176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ad8-45a6-4997-9a3c-55eca0c5003c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:09.246913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 449/900] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:09.253521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:09.253870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:09.254075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:09.267887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 452/901] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:09.280190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:09.282275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:09.385810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 450/902] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:09.661530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:09.741095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:09.804484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:09.833063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32998ac-49ae-4ca5-a423-5bd4d966d603 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:09.898466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:09.899813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:09.900513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:09.901377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:09.902523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:09.905342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:09.923935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:09.926431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:09.928153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 453/903] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:09.932639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:09.953846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a40b-4f1a-4355-8448-3634c946c0f4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.015353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:10.028898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.030759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.031531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.032594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.034900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.036972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:10.058031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:10.059922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:10.061659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:10.066359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 451/904] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 21 09:53:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:10.073578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.147030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f91d4-d9b4-43ba-88e3-c38081542262 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.226484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.227710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f613-c686-4eeb-ae85-a9d5dd7c7c6f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.228796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.229826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.232184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.233733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.234591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.239204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.253918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 454/905] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:10.261106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.275504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.276129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.276454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.276744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.277393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.277748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.279167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.293567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 452/906] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:10.295217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.308183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:10.411857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5cd2e-fd2e-468f-99c1-24c0a260f9da None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.412750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:10.456258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.456886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.457159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.457423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.458291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.458546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.459894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.470948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 455/907] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:10.472074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.499978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152469f8-7d86-46b1-a723-73c8796cc668 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.566803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:10.575617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.577041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.577825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.578642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.580122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.580973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.584946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.601809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 453/908] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:10.602219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8398d-c02f-43d2-8ec7-c241534b571b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.603861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.636145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.636760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.637102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.637401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.638075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] RBAC: Adding query filter params (interface=public, service_id=0f84941b68804fd2a5935db587e19808, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.638436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.639945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.651392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 456/909] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/endpoints?service_id=0f84941b68804fd2a5935db587e19808&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:10.653526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.798684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b4ab-7839-4183-a3ef-988b5a60d637 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.838854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a159d5-c9fa-4e83-bb4a-984597b00eb7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:10.849446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.851794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.852573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.853864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.855675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.860406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.868962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:10.882559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 457/910] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/services => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 09:53:10.894919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:10.896492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:10.897262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:10.898019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:10.899769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] RBAC: Adding query filter params (interface=public, service_id=bb3d3a259e51477493326488b291eff0, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:10.900645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:10.903716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc30c9-2a4f-455d-b952-7b5993c33218 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:10.916107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 454/911] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/endpoints?service_id=bb3d3a259e51477493326488b291eff0&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:10.926824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:10.945923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:11.138280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c58a-8541-4414-84a0-b16e66a636bd None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:11.204534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:11.206560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.207314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.208042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.209476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:11.212239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ab114-0e42-48ba-9f1e-2fe311b14d25 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:11.225899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 458/912] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:10 2022] GET /identity/v3/services => generated 1497 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 09:53:11.245019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6be85-d6a9-4495-9057-0b31798475d5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.245809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6be85-d6a9-4495-9057-0b31798475d5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.245809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6be85-d6a9-4495-9057-0b31798475d5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.246998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 455/913] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:11.253361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.253795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.254172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.278748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:11.279987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:11.385551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:11.395663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:11.665250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1e65-98d7-4a15-a8fe-552e5bee42b8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.665920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1e65-98d7-4a15-a8fe-552e5bee42b8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.666636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1e65-98d7-4a15-a8fe-552e5bee42b8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.669766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 456/915] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:11.671595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:11.677144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.677647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.678129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.725574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:11.727889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:11.866296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 457/916] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:11.892575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91ebe-56d4-4c07-b583-02846497812a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:11.957375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:11.958349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:11.958839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:11.959317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:11.960340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:11.962812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:11.980245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:11.982198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:11.983352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 460/917] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:11.989060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.104470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec49ec5-82ed-44f6-8897-ca449de3c789 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.134782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:12.157069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.157976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.158490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.159445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.160574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:12.161072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:12.163660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:12.178472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 458/918] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:12.184529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.295165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.333915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:12.411547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef41-5fa3-4a64-9151-0d562b964626 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.437003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc7371-cb96-47f8-8f93-22bcae782d70 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.475352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.476656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.477132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.477770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.478989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:12.479533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:12.482023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:12.484587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.486020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.486919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.487704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.491701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 461/919] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:12.497966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.509405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:12.514953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:12.516005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:12.516893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:12.520312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 459/920] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:12.526292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.604236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:12.628902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9667151-da86-4c6b-ad46-989af4bd0dc1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.658359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:12.668859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.669848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.670354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.670812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.671700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] RBAC: Adding query filter params (interface=public, service_id=8da34da9b89546fa8344ca19c95e3916, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:12.672194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:12.673765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:12.685073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 462/921] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/endpoints?service_id=8da34da9b89546fa8344ca19c95e3916&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:12.686778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.725395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bf38e-2594-4b2d-a0d6-70d1881edb9d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.791318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.792410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.792884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.793370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.794626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:12.795159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:12.797787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:12.805653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b4c4-8d9f-48ea-a6ec-1204fdc67af1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:12.814488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 460/922] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:12.822543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:12.848988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:12.849976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:12.850507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:12.850976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:12.852025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:12.854671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:12.874140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 463/923] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 09:53:13.018643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc7b9-7fa4-4baf-aff7-802f1f90be4d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:13.021723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:13.084813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:13.085480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.085768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.086028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.100157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:13.101670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:13.119508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:13.121375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:13.123857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:13.123857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:13.123857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:13.123857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 461/924] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:13.135281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:13.257298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:13.323174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449ec-fcd4-4b31-92eb-abbe76c22188 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:13.369984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:13.371094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.371619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.372115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.373143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:13.373705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:13.375477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c55df-b756-482c-9b0b-7e5eabf5a1a1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:13.392117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 464/925] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:13.401025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:13.487796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30601fb8-54f4-4045-abca-91575d29133f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.488524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30601fb8-54f4-4045-abca-91575d29133f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.488799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30601fb8-54f4-4045-abca-91575d29133f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.490827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 465/926] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:13.496434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.496708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.496983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.519964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:13.521286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:13.611211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 466/927] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:13.645002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6211-3f4a-4f4d-9720-91938b608bd9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:13.723450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:13.724943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.725654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.726399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.742360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:13.745568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:13.772298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:13.774518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:13.777109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 462/928] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:53:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:13.791446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:13.844062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:13.891117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:13.907887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5693f-9d0c-413e-810b-7368f6ae43ed None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:13.911726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:13.947722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:13.948360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:13.948670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:13.949385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:13.950150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:13.950490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:13.952646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:13.977794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 467/929] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:13.986793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.026599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212e1c0-773c-4ecb-8b26-e85a1475407a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.073030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.074132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.074703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.075182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.075973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.077574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:14.087911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:14.088957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 09:53:14.089836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:14.098294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 463/930] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:14.100014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.163932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1caa4-bd12-4f28-b8c9-ec9cc368bc18 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.167658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:14.206868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.207548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.207828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.208087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.219693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.221747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:14.238138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:14.240230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:14.242961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:14.242961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:14.242961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:14.244489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 468/931] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:14.245527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.276903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:14.322196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0170-033e-40d4-99d9-6be83f30b766 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.361858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3ac8-e337-4dd8-bdb0-b0eede2b7dd7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.388984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.390621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.391456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.392286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.394260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:14.395181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.398654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.400630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.401486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.401683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.401958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.402649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:14.402955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.404469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.411245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 464/932] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:14.419336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.428593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 469/933] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:14.430016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.456382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:14.613742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22474f67-e602-4e7e-8bc4-15606765091c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.620769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0028f0-0a23-4b7c-af65-b191bc51bd65 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.680115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.681051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.681511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.681983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.683022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.684289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.684973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.685668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.687033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:14.687780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.691089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.695281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.697792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.702056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 465/934] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Sep 21 09:53:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:14.716567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-541fb738-230e-46a3-a8b2-4efb46d441a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:14.727236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:14.729040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:14.730843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 470/935] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:14.736571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:14.737742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d1da-22a1-4f72-a9ee-15c589044161 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.738178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d1da-22a1-4f72-a9ee-15c589044161 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.739025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6d1da-22a1-4f72-a9ee-15c589044161 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.740548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 471/936] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:14.742274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6d1da-22a1-4f72-a9ee-15c589044161 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:14.853157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:14.876567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25106-5e25-4384-819b-45cc76e7a3d6 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.889062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6d1da-22a1-4f72-a9ee-15c589044161 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:14.931342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.932475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.932988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.933467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.934747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.937324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0129526-fc9b-4e67-91aa-3dcce336ad2f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.944293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:14.945335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.945841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.946363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.947654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:14.948203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:14.950974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:14.972395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 466/937] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:14.975210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e17c-ebcb-46c1-8b20-566214da38cd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:14.975559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 472/938] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:14.976304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e17c-ebcb-46c1-8b20-566214da38cd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:14.976806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e17c-ebcb-46c1-8b20-566214da38cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:14.985376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:15.015462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e857e17c-ebcb-46c1-8b20-566214da38cd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:15.018513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e857e17c-ebcb-46c1-8b20-566214da38cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:15.167590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:15.196778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 467/939] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:15.228712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414931-92a3-45cd-87de-16ecdfcd42bc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:15.303175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:15.304310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:15.304888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:15.305384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d17d0df9842d415fa8512364e47532c0/roles/70e90ac265df47088a469f9e537e12d2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:15.309591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=d17d0df9842d415fa8512364e47532c0, role_id=70e90ac265df47088a469f9e537e12d2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:15.312476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768ab2-cc36-446a-9088-30228cbc8cbc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:15.318199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:15.342721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 473/940] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:53:14 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d17d0df9842d415fa8512364e47532c0/roles/70e90ac265df47088a469f9e537e12d2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:53:15.385562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06360e-8cd7-4f3f-ab62-a2911d752e31 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:15.385866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06360e-8cd7-4f3f-ab62-a2911d752e31 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:15.386126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06360e-8cd7-4f3f-ab62-a2911d752e31 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:15.387839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 468/941] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:15.395202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:15.395708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:15.396197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:15.431046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:15.433168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:15.574670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 474/942] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:15.772042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06360e-8cd7-4f3f-ab62-a2911d752e31 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:15.848752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:15.920826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06360e-8cd7-4f3f-ab62-a2911d752e31 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:15.965117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:15.965873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:15.966184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:15.966487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:15.967045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:15.968977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:15.979398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46375e69-ff27-4177-9c8d-5e65112eeb04 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:15.980730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:15.982500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:15.984279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 469/943] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Sep 21 09:53:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:15.997487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.018292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:16.029169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.030346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.030633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.030910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.031524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.033009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:16.048084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:16.050665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:16.052439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 475/944] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:16.057116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.074039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:16.127856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32a91d-d8f4-48a3-8d3f-cd4e9b0b4152 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.166075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.166913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.167163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.167511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.168282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:16.168659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.170143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.176576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 470/945] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:16.185943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.193125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e554e-3ce2-449f-af2c-67de8b6089b9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.231174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.232524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.233019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.233477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.234331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:16.234846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.236553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.247694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 476/946] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:16.249459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.313413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:16.366972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ab45d-72e1-4293-9e2c-5f06742033f3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.383874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357e77-550e-4e9c-987a-8f1608f4af52 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.405659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.406669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.407136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.407669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.409053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:16.409551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.411146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.421868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 477/947] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:16.423564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.424537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:16.449714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.450959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.451544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.452099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.453373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:16.453971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.457250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.474660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 471/948] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:16.479327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:16.544357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf121dbe-df4a-4141-9e06-d842b31a1e7f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.564629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:16.587295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.588317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.588826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.589310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.590198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.591851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dd94f-88a6-45af-b3bc-117ecf2afb85 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.624976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 478/949] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:16.677422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811c61-eca6-444f-8027-a1b635b14660 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:16.768547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:16.769615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:16.770114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:16.770619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:16.771894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:16.774675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fa0a8-ed15-4c25-9a76-e651be7aade9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:16.813609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 472/950] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:53:17.840010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dbc69-bb3e-4b27-a847-df8cc2aece8f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:17.840534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dbc69-bb3e-4b27-a847-df8cc2aece8f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:17.840988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dbc69-bb3e-4b27-a847-df8cc2aece8f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:17.844440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 479/951] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:17.852851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84370-da6e-46b9-8338-ae1b59e8cc4d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:17.853366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84370-da6e-46b9-8338-ae1b59e8cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:17.853800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84370-da6e-46b9-8338-ae1b59e8cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:17.885005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d1d84370-da6e-46b9-8338-ae1b59e8cc4d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:17.886697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d1d84370-da6e-46b9-8338-ae1b59e8cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:17.936199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:18.008511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 473/952] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:18.278775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dbc69-bb3e-4b27-a847-df8cc2aece8f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:18.285349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473c5-0269-4dca-9c9e-63bb969b3287 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:18.285659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473c5-0269-4dca-9c9e-63bb969b3287 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:18.285914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473c5-0269-4dca-9c9e-63bb969b3287 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:18.287600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 474/953] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:18.292892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:18.293176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:18.293459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:18.313402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:18.314791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:18.405118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 475/954] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 21 09:53:18.433322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dbc69-bb3e-4b27-a847-df8cc2aece8f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:18.507483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:18.508608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:18.509122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:18.509617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:18.532660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:18.542971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:18.544105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:18.544953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:18.545593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 480/955] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:18.552856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:18.658038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:18.672791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96215c-984f-4927-8b39-493cf66d3d06 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:18.711599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:18.712216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:18.712678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:18.713113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:18.713934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:18.714422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:18.715957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:18.726690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 476/956] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:18.732317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:18.774490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:18.835840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:18.888613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1eb9-3eb1-44e9-b2d0-3c26ab398438 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:18.957870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52cbf8-1708-4da0-9f45-96fa52951b26 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:18.962172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:18.963254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:18.963714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:18.964160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:18.988106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:18.991366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.002724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.003371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.003650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.003922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.004611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.006135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.009026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING keystone.server.flask.common [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:19.024562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:19.025666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:19.026652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:19.026652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:19.026652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:19.027758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 481/957] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:19.030585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.sql.core [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 09:53:19.030585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 09:53:19.030585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [parameters: {'id': 'a9203e11ed5244748a79352336fe37c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 09:53:19.030585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81476) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 09:53:19.033905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9203e11ed5244748a79352336fe37c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9203e11ed5244748a79352336fe37c1. Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:53:19.047767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result.read() Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 21 09:53:19.049391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application yield resource Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise self.value Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application session.commit() Sep 21 09:53:19.056413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.session.flush() Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application compat.raise_( Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 09:53:19.057392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 09:53:19.058779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result.read() Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:53:19.060024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [parameters: {'id': 'a9203e11ed5244748a79352336fe37c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.061070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:19.061982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9203e11ed5244748a79352336fe37c1. Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.063272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 477/958] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Sep 21 09:53:18 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:19.066837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.088219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.189046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.207179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b160f-c671-4a8a-86c5-976dc46c556f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:19.212728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed4d2-5a14-4acd-bdad-14cf0d630d4e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:19.243642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.244264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.244545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.244819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.245471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:19.245772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.247196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6882861-a093-42c7-911f-73a01b5f145d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.257932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.258608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.258892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.259161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.266751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 482/959] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:19.266751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271ac8c-da27-4783-a75e-8b87a4c24fdf None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.266751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271ac8c-da27-4783-a75e-8b87a4c24fdf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.266751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271ac8c-da27-4783-a75e-8b87a4c24fdf None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.266751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 483/960] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:19.270731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271ac8c-da27-4783-a75e-8b87a4c24fdf None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.272133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.273824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-dcc9ea9d-79a1-4c75-a507-8e91108cb5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:19.286513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:19.287666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:19.288592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 478/961] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:19.289409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.289698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.289975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.309296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:19.310904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:19.390539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.400771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271ac8c-da27-4783-a75e-8b87a4c24fdf None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:19.406335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 479/962] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:19.406335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.457854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.458900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.459201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.459452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.468719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.470189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-cab6286b-5e09-46cc-88ec-bac9b6a65062 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:19.483056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:19.484192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 09:53:19.485211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:19.489605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 484/963] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:19.491026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0b75-d6ca-4083-b4f0-77b729e09fb4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.491315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0b75-d6ca-4083-b4f0-77b729e09fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.491594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0b75-d6ca-4083-b4f0-77b729e09fb4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.494340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 485/964] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:19.496007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0b75-d6ca-4083-b4f0-77b729e09fb4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.509551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.568503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4fa16-0c9d-45a2-b9dc-07a92ffa1311 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:19.614683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.615367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.615654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.615937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.616671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:19.616990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.618854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218078ef-eed4-4538-9f1d-381c6f49aacf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.642227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0b75-d6ca-4083-b4f0-77b729e09fb4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:19.642915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 480/965] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:19.644552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.645327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.645826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.670516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:19.672550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:19.698979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:19.700031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:19.700571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:19.701066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:19.702417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:19.703025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:19.707215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:19.733516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 486/966] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:19.741844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.788291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.819133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 481/967] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:19.820846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:19.880880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:19.963871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a658d-8780-4fc5-8420-9bc9882888ca None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.010357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00c13-6593-45e8-ac34-e113b448ed1a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.011192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.011192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.011192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.011609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.090855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.092488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.094055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.097337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.098163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.098992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.100517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.103403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:20.130660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:20.132917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:20.135563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.139876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 482/968] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:20.145632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.170902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.219185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.226541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 487/969] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 09:53:20.234497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.290369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29e55-f1e8-4e57-8e12-03a55ed5c198 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.342030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.342812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.343430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.343792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.344686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:20.345102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.347151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.354835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 483/970] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:20.354835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.405662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac9440-cbd9-427d-92af-b46e5b71afa9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.462107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.463723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.464416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.465431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.488905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.491785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:20.521703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:20.522949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:20.523955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:20.523955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:20.523955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:20.523955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 488/971] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:20.525055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.534485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff96-0c7c-4832-a8cd-33c44e1fd8ef None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.551995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.562685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.586629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.587693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.588182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.588680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.589752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.592516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:20.609693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:20.612657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:20.615863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 484/972] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:20.620316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.686074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6fdb-c493-4e15-9cf4-3e9d1e64a896 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.748248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.748767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.749053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.749365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.749992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:20.750328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.752018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.765435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 489/973] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:20.765435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.801917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc958-6773-4c27-8b4f-0e082bf70de3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.862717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.863419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.863712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.863980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.864755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:20.865076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.866652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.894289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 485/974] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:20.894289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:20.900479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.928957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fea09-767e-4311-9f01-9eaad777e679 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:20.977576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:20.978678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:20.979019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:20.979481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:20.980265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:20.980695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:20.982285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:20.985887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:20.989603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 490/975] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:20.990424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:21.110476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8e99-aa0e-4ec8-91de-627d50d68d16 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:21.142158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295eabd-f2ae-4823-acaf-868fe5142f24 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:21.163840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:21.164530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:21.164845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:21.165088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:21.165813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] RBAC: Adding query filter params (interface=admin, service_id=8da34da9b89546fa8344ca19c95e3916, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:21.166121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:21.167557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:21.181829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 486/976] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/endpoints?service_id=8da34da9b89546fa8344ca19c95e3916&interface=admin®ion_id=RegionOne => generated 193 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:21.181829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:21.211368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:21.212212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:21.212658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:21.213106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:21.225181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:21.227467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:21.247279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:21.249253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 491/977] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:21.251195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:21.259839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:21.380418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04e70b-f1c0-4b6e-934b-dd904a94bc1a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:21.383576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:21.391610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafb34-9230-497d-857f-ee8ee57feefc None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:21.444122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:21.445623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:21.446430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:21.447189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:21.448043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:21.448946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:21.449140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:21.449421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:21.449914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:21.451127 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:21.451679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:21.453111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:21.454169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:21.462766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 487/978] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:21.464236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:21.466294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 492/979] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:21 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 09:53:21.675245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea21a0d-e81c-418a-a967-533eeb71d320 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:21.720774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:21.721916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:21.722200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:21.722506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:21.723240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:21.723546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:21.725062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c68e-8fc4-42e9-b50a-4207d58bc784 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:21.740490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 488/980] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:21.751878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:21.892097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:21.961381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92125d45-fe4c-436b-b27a-c7d1ecaee84e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:22.023829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:22.024850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:22.025223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:22.025624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:22.030534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] RBAC: Adding query filter params (role.id=70e90ac265df47088a469f9e537e12d2, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d17d0df9842d415fa8512364e47532c0) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:22.030534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:22.030534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d4ceb-eb9e-48b2-964b-75bf96ec17b4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:22.041604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 493/981] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:21 2022] GET /identity/v3/role_assignments?user.id=d17d0df9842d415fa8512364e47532c0&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=70e90ac265df47088a469f9e537e12d2 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:22.302484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879072e5-6c30-49ed-b2ce-9bfa9872c002 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:22.303255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879072e5-6c30-49ed-b2ce-9bfa9872c002 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:22.303255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879072e5-6c30-49ed-b2ce-9bfa9872c002 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:22.304426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 489/982] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:22.314110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:22.315182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:22.315671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:22.347822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:22.350278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:22.478542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 494/983] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:22.774355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879072e5-6c30-49ed-b2ce-9bfa9872c002 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:22.809723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:22.950674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879072e5-6c30-49ed-b2ce-9bfa9872c002 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:23.015436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:23.016747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:23.017429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:23.018696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:23.020077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:23.023082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:23.047711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.sql.core [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 09:53:23.047711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 09:53:23.047711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [parameters: {'user_id': '406e180764ae4355ab10b941f4239b7d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 09:53:23.047711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81476) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result.read() Sep 21 09:53:23.060850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:53:23.062766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application yield resource Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application next(self.gen) Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise self.value Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application session.commit() Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 09:53:23.065430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.session.flush() Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application compat.raise_( Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 09:53:23.067366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 09:53:23.069429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application conn.query(q) Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application result.read() Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 09:53:23.072839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [parameters: {'user_id': '406e180764ae4355ab10b941f4239b7d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:23.075911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 21 09:53:23.079100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:23.082346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 490/984] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Sep 21 09:53:22 2022] POST /identity/v3/users => generated 160 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:23.086056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:23.214219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:23.292900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac85c7-b079-4a8d-8e48-90c9a2d27c1e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:23.350588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:23.352084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:23.352854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:23.353458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:23.365410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:23.368363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b1af2831-b982-4b24-99c5-409559575e81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:23.390411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:23.393053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 09:53:23.395753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:23.399597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 495/985] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:53:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:23.409588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:23.577594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:23.601455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7aebf-dd0a-40ef-9c66-921f603b4ba2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:23.669823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:23.670899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:23.671394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:23.671875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:23.673124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:23.673777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:23.676878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d572-994a-4b2b-b5c9-834163dbf9cb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:23.750554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 491/986] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Sep 21 09:53:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:24.154283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7680-ad83-4f73-8071-3f91ec3ab69c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.154809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7680-ad83-4f73-8071-3f91ec3ab69c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.154809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7680-ad83-4f73-8071-3f91ec3ab69c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.156485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 496/987] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:24.162800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94e08-f116-457e-ac3b-822114ce4a24 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.163120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94e08-f116-457e-ac3b-822114ce4a24 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.163351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94e08-f116-457e-ac3b-822114ce4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.184534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7ac94e08-f116-457e-ac3b-822114ce4a24 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:24.186145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7ac94e08-f116-457e-ac3b-822114ce4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:24.265393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 492/988] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:24.533043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7680-ad83-4f73-8071-3f91ec3ab69c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:24.619275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e3221-6421-4fab-9f31-16fa46dd254c None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.619923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e3221-6421-4fab-9f31-16fa46dd254c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.619923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e3221-6421-4fab-9f31-16fa46dd254c None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.621563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 493/989] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:24.627412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.627688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.628028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.650821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7680-ad83-4f73-8071-3f91ec3ab69c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:24.651088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:24.652376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:24.676487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:24.689204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:24.689968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.690268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.690543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.691116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:24.692493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:24.702449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:24.703530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 09:53:24.704386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:24.709734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 497/990] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Sep 21 09:53:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:24.710096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:24.754478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 494/991] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:24.878623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4452c-7e7b-4b73-8d44-b82523937b3a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:24.942735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:24.943793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.944271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.944678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.945334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:24.945785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:24.947447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a16f7f-e6db-45ed-841e-0a36022af2f6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:24.962551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 498/992] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:24.967008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:24.983941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:24.985807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9bbe-d1bb-4e1c-b756-476e30d179a6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.986395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9bbe-d1bb-4e1c-b756-476e30d179a6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.986880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9bbe-d1bb-4e1c-b756-476e30d179a6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:24.989259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 499/993] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:24.995969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:24.996464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:24.996955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.027561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:25.029629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:25.107635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:25.123312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d413e11-a04c-484a-9955-c494a6d02fed None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.150448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 500/994] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:25.151861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:25.180852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.181478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.181757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.182028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.182714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:25.183017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.184400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.193044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 495/995] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Sep 21 09:53:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:25.201193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:25.316013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2ca2-96b3-4acc-9e6b-db9d26588425 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.318426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:25.374915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502228db-abda-4232-8a7a-940988d4d89c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.375538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.376528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.377529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.378043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.378999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.380640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:25.395832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:25.397512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:25.399084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 501/996] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 21 09:53:25 2022] GET /identity/v3/services/image => generated 86 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:25.407565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:25.441753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.442754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.443222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.443670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.444790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.447172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.478925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 496/997] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:25.499406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:25.545242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:25.596635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff8a2-c711-42ea-b10b-6967123787d6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.654016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.654931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.655237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.655495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.656641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] RBAC: Adding query filter params (name=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:25.656945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.659124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.665455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 502/998] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:25.671670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:25.739235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9b1ee-0da4-4085-83f7-8a8b4f3f50dc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.781232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:25.791905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.792925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.793825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.794983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.796778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.799728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea01fe-7d6e-4286-9eec-d9cbffd10f0e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.815782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd57f-2d76-4865-a683-9b80f4488e12 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:25.818785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:25.822670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 497/999] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:25 2022] POST /identity/v3/services => generated 242 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:25.865465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:25.866100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:25.866418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:25.866691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:25.867364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:25.867652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:25.869094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0e18-7499-4744-86f8-ec827d1a23e5 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:25.879003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 503/1000] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:28.046318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed4a3-349c-4b92-bf05-84a620271d00 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.046825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed4a3-349c-4b92-bf05-84a620271d00 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.047319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed4a3-349c-4b92-bf05-84a620271d00 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.050431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 498/1001] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:28.056312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9feb5-9586-4866-a1a7-f19e8f53e557 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.057063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9feb5-9586-4866-a1a7-f19e8f53e557 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.057063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9feb5-9586-4866-a1a7-f19e8f53e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.077303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-33f9feb5-9586-4866-a1a7-f19e8f53e557 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:28.078625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-33f9feb5-9586-4866-a1a7-f19e8f53e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:28.158805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 504/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:28.295794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42998a-7ac1-4704-aa95-1f5bbc05fc8d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.296057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42998a-7ac1-4704-aa95-1f5bbc05fc8d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.296501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42998a-7ac1-4704-aa95-1f5bbc05fc8d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.298045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 499/1003] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:28.305380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.305798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.305980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.331087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:28.332565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:28.413745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 505/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:28.437950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42998a-7ac1-4704-aa95-1f5bbc05fc8d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:28.561841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42998a-7ac1-4704-aa95-1f5bbc05fc8d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:28.603986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:28.604631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.604910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.605185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.606403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:28.607902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:28.609774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 500/1005] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:28.616000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:28.645124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:28.693340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:28.758621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1392-84b4-4861-bcb5-3374d3394b38 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:28.771068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:28.805356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:28.805978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.806318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.806571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.807244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:28.808705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:28.824755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3ab3-6596-4812-82af-6abb1ce9f6d2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:28.845959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 506/1006] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:28 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:53:28.878072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:28.879014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:28.879430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:28.879869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:28.881178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:28.882934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-563fbe55-3e09-43ed-a064-6c167e474a75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:28.895312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:28.898447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:28.900251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 501/1007] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:28.911764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:29.018761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:29.050022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb947-6603-46ae-8179-05ab41ed8872 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.050887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb947-6603-46ae-8179-05ab41ed8872 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.051028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb947-6603-46ae-8179-05ab41ed8872 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.053141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 502/1008] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:29.055368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939eff5-6c91-44aa-87ad-ba4c67a2895d None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:29.060270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.061549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.062006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.089004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:29.090877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:29.097278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:29.098101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.098310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.098477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.099102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:29.099408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:29.100820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:29.106518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 507/1009] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:29.116828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:29.172206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 503/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:29.302563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ab25d-2194-4ef7-bc55-441d9633a903 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:29.379850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:29.380910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.381411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.381902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.383097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:29.383650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:29.386189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:29.396279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 508/1011] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:29.402751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:29.499884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:29.560707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:29.565198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52d33-c3cf-443c-a8c3-c57a4d13eb55 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:29.567508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:29.637248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:29.638223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.638843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.639501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.641058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] RBAC: Adding query filter params (interface=public, service_id=0ee9fa22dec7400ca05a4c649ba8e725, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:29.643026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:29.644926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:29.658471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 504/1012] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:53:29 2022] GET /identity/v3/endpoints?service_id=0ee9fa22dec7400ca05a4c649ba8e725&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:29.664435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:29.714562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca658f-c017-4187-b07a-cc0458e54f2a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:29.767294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:29.768788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.769199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.769626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.770793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:29.773175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24c2ac-cac6-4cff-b7da-cfa9db4d19f8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:29.810117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 509/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:53:29 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:53:29.842884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08495e4-b1f1-4fa5-873a-2be92b709011 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:29.865235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:29.900129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:29.900876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:29.901298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:29.901706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:29.902545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:29.904213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa9a00-f44a-4688-92c1-3c7fe5094891 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:29.912842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 505/1014] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:29 2022] GET /identity/v3/services => generated 1957 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 09:53:31.335368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba220c-768d-4d0c-b6df-7e5c6ce61fed None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:31.335909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba220c-768d-4d0c-b6df-7e5c6ce61fed None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:31.335909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba220c-768d-4d0c-b6df-7e5c6ce61fed None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:31.337584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 510/1015] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:31.343630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:31.344087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:31.344164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:31.364703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:31.365924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:31.437758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 506/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:31.761176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba220c-768d-4d0c-b6df-7e5c6ce61fed None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:31.830777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:31.873348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba220c-768d-4d0c-b6df-7e5c6ce61fed None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:31.911563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:31.912202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:31.912479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:31.912750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:31.913873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:31.915352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c20ca-8965-4022-a6de-b437219b9d6b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:31.917179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 511/1017] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:31.922663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:32.043191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95419ede-43d8-4455-88d8-6ea27998f1f1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:32.053501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:32.090652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:32.091688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.092240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.092728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.094304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:32.097620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670d3d-60cf-4d22-a7f9-372575d54dc9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:32.130618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 507/1018] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:53:31 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:53:32.312832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d766-6509-4dca-83f6-2eea96f3d64b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.313257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d766-6509-4dca-83f6-2eea96f3d64b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.313758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d766-6509-4dca-83f6-2eea96f3d64b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.316463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 512/1019] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:32.322612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524600-0566-4374-990c-8b1741644e17 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.322869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524600-0566-4374-990c-8b1741644e17 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.323206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524600-0566-4374-990c-8b1741644e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.336871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d87c9-3043-42ef-9910-4acb389631bc None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.337454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d87c9-3043-42ef-9910-4acb389631bc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.337454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d87c9-3043-42ef-9910-4acb389631bc None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.338980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 513/1020] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:32.344381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-28524600-0566-4374-990c-8b1741644e17 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:32.344859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.344859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.345029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.346286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-28524600-0566-4374-990c-8b1741644e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:32.364366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:32.365581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:32.439658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 508/1021] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:32 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:32.449964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 514/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:32 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:32.719382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524600-0566-4374-990c-8b1741644e17 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:32.818750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:32.832394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:32.850989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524600-0566-4374-990c-8b1741644e17 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:32.898575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:32.902641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:32.903380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.903659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.903963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.904943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:32.906884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:32.922793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:32.924899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 09:53:32.926007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:32.932655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 509/1023] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:32.934538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:32.951484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898db7-bb0e-4b2b-bdbe-3cfa7d1abde7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:32.994523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:32.995525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:32.995987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:32.996387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] PATH_INFO: `/v3/services/image` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:32.997831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.000546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:33.017407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:33.018557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:33.019483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:33.020258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 515/1024] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 21 09:53:32 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:33.025577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.081464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda4ea-6cf1-4f0a-bab1-05b17002088b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.123525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.124147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.124419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.124693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.125600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:33.125600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.127597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.133047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 510/1025] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:33.141044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.160550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803184e1-a16c-4d03-8b06-e683ce6fd444 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.169779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:33.203501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:33.214483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.215088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.215365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.215639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.216279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:33.216579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.218215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.224261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 516/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:33.231208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.280720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e81b37-fcc4-46d2-b03a-2c9cab30535d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.327875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.329636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.330288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.330636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.332760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:33.333331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.336014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.346661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 511/1027] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Sep 21 09:53:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:33.352629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.365916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095d29c-19a3-4d54-9922-67dfcdd28bb9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.428878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.429516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.429792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.430065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.430729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] RBAC: Adding query filter params (type=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:33.431038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.432438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.437910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 517/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:33.443792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.469890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:33.500635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3a155-762f-4b89-ac23-028ddf556f24 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.506776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:33.556753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.557287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.557568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.557837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.558552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.559608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3723-dc3a-45f9-8199-c980ac0fff67 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.559921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.583023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 512/1029] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:33.642888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.643979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.644475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.645048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.646005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] RBAC: Adding query filter params (interface=public, service_id=eec21e51c3a042e193f5e6cd30ae9d02, region_id=RegionOne) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:33.646345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.648156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a8cbe-a237-4388-b1f3-92e6c373f66e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.659275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 518/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:53:33 2022] GET /identity/v3/endpoints?service_id=eec21e51c3a042e193f5e6cd30ae9d02&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:33.665205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:33.813121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0369-562d-47bf-8bc2-ef3167bf3298 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:33.871917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:33.872968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:33.873453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:33.873933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:33.875075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:33.877482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085bb9c-fbc4-4a0a-92cc-92900ff3bbd3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:33.890855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 513/1031] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:53:33 2022] GET /identity/v3/services => generated 1957 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 09:53:34.584998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3582-c0c7-4056-a06c-b6928eca8ee4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:34.585587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3582-c0c7-4056-a06c-b6928eca8ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:34.586095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3582-c0c7-4056-a06c-b6928eca8ee4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:34.588706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 519/1032] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:34.596022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:34.596772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:34.596772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:34.606225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:34.619240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:34.620568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:34.724348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 514/1033] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:35.007704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3582-c0c7-4056-a06c-b6928eca8ee4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:35.156502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3582-c0c7-4056-a06c-b6928eca8ee4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:35.174807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:35.210412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:35.211458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:35.211935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:35.212406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:35.231760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:35.241536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:35.242549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:35.243412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:35.244111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 520/1034] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:35.250166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:35.359528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df05ab-4fd9-4137-99cf-098d00e5c642 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:35.397586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:35.398437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:35.398854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:35.399270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:35.400084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:35.400506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:35.402001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:35.403818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:35.418867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 515/1035] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:35.420814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:35.546960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bf87-50c0-49cb-a0f6-b3e668fb0c33 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:35.585269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:35.586285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:35.586285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:35.586593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] PATH_INFO: `/v3/users/b52e73372b7f4b24b02ee598541bfb2f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:35.603009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] RBAC: Authorizing `identity:get_user(user_id=b52e73372b7f4b24b02ee598541bfb2f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:35.604483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7122-0b44-4ab4-bce8-0e55196b193a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:35.614378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 521/1036] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:35 2022] GET /identity/v3/users/b52e73372b7f4b24b02ee598541bfb2f => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:35.617189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:35.795487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7a71-7791-4e97-933f-9220016a992e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:35.855483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:35.856513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:35.857077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:35.857578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:35.970310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:35.979146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:35.980709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:36.104686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 516/1037] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:36.106569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.107051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdd1e-cf62-4e94-872f-8643f6a790db None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.107324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdd1e-cf62-4e94-872f-8643f6a790db None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.107597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdd1e-cf62-4e94-872f-8643f6a790db None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.109213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 522/1038] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:36.115322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.115666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.115921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.139818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:36.142342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:36.187932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:36.223417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:36.229638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14cdb8-5bf3-4142-b137-2783285e67b1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:36.274270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 523/1039] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:36.274479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:36.274479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.274479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.274479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.274791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:36.275773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da69fd-2762-43b8-95f7-0e3fb602813d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:36.278278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 517/1040] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:36.288532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.366878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145280-fff1-424a-b17d-42c3b2c43892 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.367372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145280-fff1-424a-b17d-42c3b2c43892 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.367497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be145280-fff1-424a-b17d-42c3b2c43892 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.369027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 518/1041] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:36.374108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007688d6-e909-4279-aea1-63f21f51235f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.374430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007688d6-e909-4279-aea1-63f21f51235f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.374713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007688d6-e909-4279-aea1-63f21f51235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.393526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-007688d6-e909-4279-aea1-63f21f51235f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:36.394777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-007688d6-e909-4279-aea1-63f21f51235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:36.463230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb62c5-ccac-49e3-9817-afeaaddc8dc6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:36.464058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 519/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:36.523368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:36.524364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.524846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.525278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.526660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=4c3e38a88c444d57b555c6368d5a01af, user.id=b52e73372b7f4b24b02ee598541bfb2f) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:36.527225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:36.529801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:36.550284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 524/1043] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/role_assignments?user.id=b52e73372b7f4b24b02ee598541bfb2f&scope.project.id=4c3e38a88c444d57b555c6368d5a01af&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:36.550536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007688d6-e909-4279-aea1-63f21f51235f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.681859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:36.696953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007688d6-e909-4279-aea1-63f21f51235f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:36.748759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.758993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:36.759671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.759956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.760225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.774316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:36.779250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:36.781040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:36.782723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 520/1044] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:36.790006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:36.796118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.885130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1462bf-6ffc-4a00-8eb0-68ee433cd544 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:36.923671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:36.924325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:36.924604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:36.925013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] PATH_INFO: `/v3/services/image` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:36.925634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:36.927403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:36.938453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:36.940473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:36.942178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 525/1045] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:36.946194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:36.952349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5693c-9220-4e9a-8911-757831a0f64c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.005186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.005569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.005862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.006128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.006831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:37.007505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.008843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.023302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 521/1046] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:37.024145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.044376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.083042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.095411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776018d4-8ff9-459a-bc76-e7c34231421a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.141255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.142855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.143169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.143502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.144187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] RBAC: Adding query filter params (name=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:37.144533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.146005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.151578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 526/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:37.159233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.168238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4cfb0-5357-431d-96c5-f3e0bb107342 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.212820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.213489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.213771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.214049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.228654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.230180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:37.258912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:37.260540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:37.262279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:37.262279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:37.262279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:37.262279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 522/1048] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:37.266546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.304759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2417053-a77c-4e29-aaf0-7e67d3959c9e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.351534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.366600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.367971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.368681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.369173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.370591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] RBAC: Adding query filter params (type=image) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:37.371359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.373648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.387847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 527/1049] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:37.390803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.396530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33aa62-ce4c-4a69-b0ed-495d97a78d16 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.426315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.440275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.441021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.441365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.441974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.443045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:37.443414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.445131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.461642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 523/1050] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:37.468361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.557301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500996-6c9d-4b5c-802f-a85393bc8381 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.609303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a42813-2754-412b-989d-92b6b85522e3 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.611873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.612541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.612832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.613105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.613793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.615234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.644682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.645717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 528/1051] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:53:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:37.671521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.672629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.673124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.674008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.688460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.691569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:37.717302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:37.718783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:37.725004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 524/1052] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:37.729224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:37.847149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:37.881507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419940b7-5178-4bdb-bf07-c41acfa1df7e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:37.920003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:37.920628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:37.920894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:37.921166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:37.921911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:37.922213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:37.924244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:37.944134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 529/1053] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:37.950298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:38.065559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447f75-dc1a-40f7-aee8-1ae9ecdb74b2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:38.106397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:38.106935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:38.107213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:38.107490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:38.165745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:38.186582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:38.188322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:38.309302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 525/1054] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 09:53:38.311290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:38.483089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1c7e-48fc-4296-9506-eeadfa8388f1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:38.533047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:38.540274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:38.540923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:38.541233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:38.541512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:38.558501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:38.560023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1e505fea-7482-4128-8e85-3d1216bc319c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:38.581754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:38.590758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:38.591762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:38.591762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:38.591762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:38.591762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 530/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:38.592014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:38.705427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:38.734750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd76e3-afe1-4cb2-b481-41b2f7c5fc0c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:38.790841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:38.791788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:38.792257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:38.793053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:38.793803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:38.794111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:38.794533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfd3-e8ab-4292-a740-b0a8cc37fa34 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:38.794816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfd3-e8ab-4292-a740-b0a8cc37fa34 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:38.795085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbcfd3-e8ab-4292-a740-b0a8cc37fa34 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:38.796227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:38.796702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 531/1056] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:38.802473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:38.802765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:38.803025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:38.814049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 526/1057] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:38.819428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:38.828605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:38.830667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:38.930296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 532/1058] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:38.968728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce949fa-f8a2-40c2-b941-345d6f777795 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.028215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.029171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.029643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.030116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.042879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:39.045533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:39.066733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:39.067719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:39.068647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:39.074449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 527/1059] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:39.075722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.197137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b1e2-211f-4236-a34d-86445cbe07de None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.199621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.204498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:39.221077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:39.244957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.245576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.245852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.246122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.246855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:39.247565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:39.248749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:39.263656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 533/1060] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:39.270584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.319211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac76bc-f673-47ac-880a-e99c7199c194 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.361543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.362188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.362493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.362800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.374196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:39.379659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:39.380650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:39.381497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 528/1061] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:39.386078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf5e0-5ed0-488e-af4d-515c58796075 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.386877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.421515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.422123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.422432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.422707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.423657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] RBAC: Adding query filter params (role.id=70e90ac265df47088a469f9e537e12d2, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:39.423798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:39.425191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:39.431002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 534/1062] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=70e90ac265df47088a469f9e537e12d2 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:39.459266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:39.504890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51405d38-ec3b-4334-af11-40e85f88afb0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.545894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.546565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.546844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.547109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.547799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:39.548101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:39.549567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:39.562329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 529/1063] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:39.569640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.646735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:39.764168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df55f4-47da-4218-a1fd-7112310a9d9f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:39.828025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:39.828998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.829481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.829977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] PATH_INFO: `/v3/users/b52e73372b7f4b24b02ee598541bfb2f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.831872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b52e73372b7f4b24b02ee598541bfb2f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:39.834445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05286821-1b8c-4a5e-ad65-2f7656cc30f3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:39.841778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 535/1064] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/users/b52e73372b7f4b24b02ee598541bfb2f => generated 285 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:39.843994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:39.921247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45447-0546-47dc-989e-4da3be3ec325 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.921591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45447-0546-47dc-989e-4da3be3ec325 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.921812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45447-0546-47dc-989e-4da3be3ec325 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.923832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 536/1065] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:39.928853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:39.929146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:39.929421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:39.950445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:39.951669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:40.015302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec522c9-a99c-45de-acb7-c94f912083d5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:40.030995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 537/1066] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:40.057551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:40.072786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:40.073854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:40.074365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:40.074806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:40.076672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:40.079337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:40.086523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 530/1067] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:39 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:40.089302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:40.147396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:40.250663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c76057-cc2e-4ca6-8744-b74b448c63cd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:40.294752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:40.295444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:40.295811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:40.296125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af/users/b52e73372b7f4b24b02ee598541bfb2f/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:40.296784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:40.299264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e38a88c444d57b555c6368d5a01af, user_id=b52e73372b7f4b24b02ee598541bfb2f, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:40.300729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:40.317047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 538/1068] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:53:40 2022] PUT /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af/users/b52e73372b7f4b24b02ee598541bfb2f/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 09:53:40.480753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057469b-f57a-44b7-991c-7ef7d20fbb02 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:40.546442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:40.547503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:40.548002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:40.548551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:40.673876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:40.690539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:40.693482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:40.838377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 531/1069] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:40.844001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:40.961927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:40.970319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e72bc-e470-4b03-b913-170e3a46ae43 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:41.010084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:41.010828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:41.011106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:41.011442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:41.023226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:41.024691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7f7b954f-e454-4186-818c-e6178f746dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:41.041206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:41.042629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:41.043562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:41.043562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:41.043562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:41.046615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 539/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:41.048968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:41.206875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:41.220026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb2b0-b34b-48c2-b861-80116f007b44 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:41.286023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:41.287083 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:41.287545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:41.288005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:41.289168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:41.289701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:41.292252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79cfc6-b365-4e11-919a-8e0f0949762b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:41.318823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 532/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:41.770687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1769e-3bb1-4dfd-8aff-85e8197d8062 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:41.771061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1769e-3bb1-4dfd-8aff-85e8197d8062 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:41.771347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1769e-3bb1-4dfd-8aff-85e8197d8062 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:41.773002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 540/1072] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:53:41.781502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:41.781987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:41.782530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:41.812294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:41.814875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:41.923933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 533/1073] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:42.197074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1769e-3bb1-4dfd-8aff-85e8197d8062 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:42.311120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1769e-3bb1-4dfd-8aff-85e8197d8062 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:42.352371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:42.353013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.353293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.353567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.366657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:42.371639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:42.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:42.375276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 541/1074] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:42.380152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:42.480834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:42.502936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d0e6-84c3-474a-98c1-443b43b54451 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:42.544583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:42.545203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.545481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.545751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.546647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:42.546845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:42.548186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b1a2f-6060-4ea4-905f-529a003f4029 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:42.563041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 534/1075] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:42.564916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:42.580167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:42.603317 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db10fa-3a75-42a5-ba3a-131b5acd059d None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.603607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db10fa-3a75-42a5-ba3a-131b5acd059d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.603881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db10fa-3a75-42a5-ba3a-131b5acd059d None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.605328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 535/1076] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:42.611814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.612100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.612359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.632036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:42.633255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:42.711038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e462-59ab-4c3d-b55b-7e389a446d93 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:42.727179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 536/1077] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:53:42.747937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:42.748482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.748758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.749023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.760636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:42.762113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:42.777535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:42.784433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:42.785373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:42.785373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:42.785373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:42.785373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 542/1078] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:42.785907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:42.915433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:42.948687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29561252-dcac-4dd5-9f23-6af33449695e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:42.986849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:42.987465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:42.987745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:42.988010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:42.988658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:42.988961 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:42.990346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:42.995735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.006131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 537/1079] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:43.011650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.072671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.122658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f99aa9-e99b-4eea-b264-81583e64d21b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.124067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747aa6-a8b0-48b3-8dfe-ec85054cbc21 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.160584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.161236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.161413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.161565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.161775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.162349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.162833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.163307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.167154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.174195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.175634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:43.175948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:43.180645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:43.182040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:43.183254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 543/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:43.188269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:43.192928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:43.194097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:43.195316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 538/1081] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:43.199970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.303305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc279-0c18-4919-909d-c027a8997a05 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.324279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.334817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94e746-057c-43c1-a114-96851a395791 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.340327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.340949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.341226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.341549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.342189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:43.342526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.344179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.354576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 544/1082] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:43.361343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.375005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.375623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.375905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.376180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.376922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:43.377228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.378725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.406582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 539/1083] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:43.410093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.476314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.479819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca40ab7-e00e-4aaf-bb36-a295c0a760f9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.525601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.526265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.526546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.526819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] PATH_INFO: `/v3/users/b52e73372b7f4b24b02ee598541bfb2f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.527896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf293b-7b68-44e1-9e9c-1c0685b13bc7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.528089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] RBAC: Authorizing `identity:get_user(user_id=b52e73372b7f4b24b02ee598541bfb2f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.529411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.531150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 545/1084] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/users/b52e73372b7f4b24b02ee598541bfb2f => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:43.537551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.569111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.569658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.569934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.570201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.581651 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.583448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.595150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:43.605728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:43.606849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:43.607761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:43.607761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:43.607761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:43.607761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 540/1085] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:43.613788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.650111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2946-704c-42d1-baef-382fd3f5e596 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.693087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.694088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.694592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.695080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.753388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4000b-81c2-4ace-8ffd-a9a0bda3e3c7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.761316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.787502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.788980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.791289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.791910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.792188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.792461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.793113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:43.793407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.794813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.807640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 541/1086] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:43.814680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.851857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:43.921578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 546/1087] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 09:53:43.931228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:43.937287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f119b-a812-4426-b613-0a70e0c5d651 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:43.976048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:43.976712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:43.976994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:43.977269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:43.984905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:43.986499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:43.999409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:44.001289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:44.003392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 542/1088] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:44.009506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:44.064471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:44.102066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd5156-04ba-4903-98b3-8d055dd08014 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:44.140778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:44.141433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:44.141781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:44.142607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:44.143823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:44.145285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:44.147042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 547/1089] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:43 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:44.154184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:44.163759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8729a-6551-423e-9b77-0fadd75b5cce None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:44.179331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:44.205194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:44.205897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:44.206202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:44.206381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:44.207084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:44.207394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:44.208837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:44.231497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 543/1090] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:44.232857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:44.276235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0a12-4cd2-428b-b90f-c66197cf67ed None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:44.312562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:44.313467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:44.313467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:44.313851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:44.314449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=4c3e38a88c444d57b555c6368d5a01af, user.id=b52e73372b7f4b24b02ee598541bfb2f) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:44.314750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:44.316206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26383d-7053-4b1e-86ca-e7d43637b442 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:44.323332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 548/1091] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:44 2022] GET /identity/v3/role_assignments?user.id=b52e73372b7f4b24b02ee598541bfb2f&scope.project.id=4c3e38a88c444d57b555c6368d5a01af&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:44.348893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:44.368517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0bd4-c7ba-4eed-9ad6-67c12d3c41da None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:44.429137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:44.430000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:44.430301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:44.430640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/70e90ac265df47088a469f9e537e12d2` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:44.433228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=3be328584a6549aeb096ab9b852daf9d, role_id=70e90ac265df47088a469f9e537e12d2)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:44.434762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ace9f-8cd2-4d24-b648-599ed7fcfc91 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:44.451728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 544/1092] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:53:44 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/3be328584a6549aeb096ab9b852daf9d/roles/70e90ac265df47088a469f9e537e12d2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:53:46.587962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceadb10-8ade-4afb-8f04-da8f8ddb4070 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:46.588524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceadb10-8ade-4afb-8f04-da8f8ddb4070 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:46.588524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceadb10-8ade-4afb-8f04-da8f8ddb4070 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:46.590112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 549/1093] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:46.596799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d41414-3689-4164-aa72-67e0143b6a0e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:46.597511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d41414-3689-4164-aa72-67e0143b6a0e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:46.597511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d41414-3689-4164-aa72-67e0143b6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:46.618833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-16d41414-3689-4164-aa72-67e0143b6a0e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:46.620034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-16d41414-3689-4164-aa72-67e0143b6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:46.690110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 545/1094] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:46.703442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb536-f0cf-499d-ba29-294509c72f00 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:46.703720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb536-f0cf-499d-ba29-294509c72f00 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:46.703971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb536-f0cf-499d-ba29-294509c72f00 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:46.706125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 550/1095] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:46.712052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:46.712369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:46.712761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:46.733294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:46.734528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:46.809646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 546/1096] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:46.963521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eb536-f0cf-499d-ba29-294509c72f00 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.087020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.087694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.096398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.112964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eb536-f0cf-499d-ba29-294509c72f00 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.157707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.158382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.158674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.158978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.160172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:47.161632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:47.163282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 551/1097] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:47.172234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.203810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1390f-4b2c-4e32-8dc3-9f42688e0b33 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.251114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.252283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.252558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.257510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.264299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:53:47.269271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:47.270762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:47.271850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 547/1098] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Sep 21 09:53:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:53:47.276565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.287023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe118-23e0-4557-b261-742272ce2ade None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.323655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.324422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.324744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.325054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.325841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:47.327417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:47.347625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.352673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 552/1099] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:53:47 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:53:47.389535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f556f4-1aba-4354-811c-aab69f59ef98 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.428940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.429564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.429842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.430111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.430828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:47.431134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:47.432619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:47.441981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 548/1100] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:53:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:53:47.448433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.459729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.580038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f0d0-d01b-4def-8c79-296a4cc61a9e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.619322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.620203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.620203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.620474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.633182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:47.634682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:47.652205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:47.653559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:47.654919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:47.654919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:47.654919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:47.654919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 553/1101] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:47.660278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.770774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569451e-0f9b-4ebb-bc2f-188b774e90bf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.804572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.812944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.813559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.813869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.814138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:47.814808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:47.815104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:47.816461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:47.829367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 549/1102] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:47.835215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:47.917603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:47.962284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604be053-1b3f-41c0-be91-57960e3a75a8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:47.998557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:47.999201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:47.999481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:47.999756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:48.008408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:48.009881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:53:48.023039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:48.024144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 09:53:48.025194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:53:48.026595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 554/1103] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Sep 21 09:53:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:48.030022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:48.138573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755ff0-c46f-4745-abd3-7b4e75c2a124 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:48.177544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:48.178172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:48.178475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:48.178776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:48.179511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:48.179811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:48.181241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:48.199892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 550/1104] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Sep 21 09:53:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:48.207119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:48.322388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b0b37-5e2e-4d29-b954-6c50deb06bc3 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:48.342179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:48.361546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:48.362162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:48.362476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:48.362746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:48.440774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:48.442207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:48.555172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 555/1105] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:48.561287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:48.614698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:48.673857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ba60-56a9-4125-9e85-f36adeda13f9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:48.716094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:48.716739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:48.717019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:48.717294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:48.730561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:48.732020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:53:48.748389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:48.749636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:53:48.750611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:53:48.750611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:53:48.750611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:48.750611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 551/1106] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:48.755660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:48.774451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:48.856577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dca7e-95bf-4a74-8425-5d7b48dde602 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:48.891030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:48.891631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:48.892439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:48.892709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:48.893346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:48.893646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:48.895048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:48.906452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 556/1107] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:48.913014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:49.007028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:49.010983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce747-ead9-4bba-9072-8a15dce346f0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:49.046608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:49.047234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:49.047509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:49.047779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:49.055115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:49.056542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:53:49.067941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:53:49.068923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:53:49.069820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 552/1108] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:53:49.075097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:49.154787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:49.178880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96573-d288-485c-8bf3-67785ff6264e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:49.211868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:49.212472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:49.212746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:49.213014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:49.213694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:49.213999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:49.215451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532f33-a140-47b6-9b9a-7dcb9f7a3c34 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:49.228184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 557/1109] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:49.234486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:49.339865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07bfe5-e474-4603-b197-e7739164151c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:49.377287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:49.377889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:49.378165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:49.378471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:49.379186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] RBAC: Adding query filter params (role.id=70e90ac265df47088a469f9e537e12d2, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=3be328584a6549aeb096ab9b852daf9d) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:49.379489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:49.380896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217a2a-f25a-480a-a94b-2c1f17dd750b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:49.386787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 553/1110] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:49 2022] GET /identity/v3/role_assignments?user.id=3be328584a6549aeb096ab9b852daf9d&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=70e90ac265df47088a469f9e537e12d2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:49.636568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd32c7-e6cc-4966-b404-635c33697b1b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:49.636863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd32c7-e6cc-4966-b404-635c33697b1b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:49.637137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd32c7-e6cc-4966-b404-635c33697b1b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:49.638521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 558/1111] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:49.644660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:49.644947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:49.645227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:49.664368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:49.665576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:49.683300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:49.738644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 554/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:50.005278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd32c7-e6cc-4966-b404-635c33697b1b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:50.111012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd32c7-e6cc-4966-b404-635c33697b1b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:50.149751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:50.150440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:50.150721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:50.150997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] PATH_INFO: `/v3/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:50.152424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] RBAC: Authorizing `identity:get_role(role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:50.153841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:50.155240 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 559/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:50 2022] GET /identity/v3/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:50.161350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:50.265696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878d750-3eee-4148-b6eb-9aa7191c6a97 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:50.300349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:50.300985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:50.301265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:50.301541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] PATH_INFO: `/v3/users/f330124aac404dc0b461f068521f816d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:50.315611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f330124aac404dc0b461f068521f816d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:50.317041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:50.318799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 555/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:50 2022] GET /identity/v3/users/f330124aac404dc0b461f068521f816d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:50.324612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:50.333358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:50.425657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0af4-4d31-4b60-8992-914921874a6c None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:50.463430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:50.464045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:50.464326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:50.464597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:50.531867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:50.533789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:50.541460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:50.642754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 560/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:50.649091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:50.663261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:50.755064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3ead-4ab3-49cd-8f7a-5fe7327d00f9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:50.794354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:50.794906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:50.795189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:50.795466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:50.796611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:50.798617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58d5b4-55d6-4cb3-8327-fbbd9a895ea5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:50.800323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 556/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:50 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:50.806772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:50.906513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a8c0-d81e-47bc-a441-fb94ddd41269 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:50.915174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:50.959405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:50.960439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:50.960946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:50.961455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:50.962872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=4c3e38a88c444d57b555c6368d5a01af, user.id=f330124aac404dc0b461f068521f816d) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:50.963440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:50.966100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b9a66-1b47-4a04-ad49-a2cbed64a0c2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:50.976637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 561/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:50 2022] GET /identity/v3/role_assignments?user.id=f330124aac404dc0b461f068521f816d&scope.project.id=4c3e38a88c444d57b555c6368d5a01af&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:53.134784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3314c2-a10a-43d4-9c73-ff94153efda4 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:53.135638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3314c2-a10a-43d4-9c73-ff94153efda4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:53.135913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3314c2-a10a-43d4-9c73-ff94153efda4 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:53.137266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 557/1118] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:53.143662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:53.144141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:53.144218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:53.163063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:53.164276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:53.242771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 562/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:53.529359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3314c2-a10a-43d4-9c73-ff94153efda4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:53.626571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:53.650371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3314c2-a10a-43d4-9c73-ff94153efda4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:53.685420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:53.686046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:53.686360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:53.686631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] PATH_INFO: `/v3/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:53.688042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] RBAC: Authorizing `identity:get_role(role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:53.689570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:53.690936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 558/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:53 2022] GET /identity/v3/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:53.696957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:53.798623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:53.802599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10540d5-a80a-4ad9-8972-23c14ebd300f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:53.838705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:53.839339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:53.839619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:53.839893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] PATH_INFO: `/v3/users/f330124aac404dc0b461f068521f816d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:53.841019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] RBAC: Authorizing `identity:get_user(user_id=f330124aac404dc0b461f068521f816d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:53.842488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:53.844349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 563/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:53 2022] GET /identity/v3/users/f330124aac404dc0b461f068521f816d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:53.850818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:53.953235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ebae5-45f6-4b96-99e6-5d397b0348de None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:53.988686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:53.989351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:53.989634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:53.989911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:53.991081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:53.992525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaa07c-307c-416d-87d3-b5701eab9a04 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:53.994189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 559/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:53 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:54.001242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:54.111336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1b7-1faf-4cde-bd27-5d4dfb61b57a None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:54.146604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:54.147317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:54.147549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:54.147820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af/users/f330124aac404dc0b461f068521f816d/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:54.150151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e38a88c444d57b555c6368d5a01af, user_id=f330124aac404dc0b461f068521f816d, role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:54.151660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060054-7e1d-4514-a522-45d98f705698 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:54.169166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 564/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:53:54 2022] PUT /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af/users/f330124aac404dc0b461f068521f816d/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:53:56.296786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782648d6-e4c4-4ab1-84ac-f29c4ac50a93 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:56.297320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782648d6-e4c4-4ab1-84ac-f29c4ac50a93 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:56.297320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782648d6-e4c4-4ab1-84ac-f29c4ac50a93 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:56.298718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 560/1124] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:56.304055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:56.304480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:56.304605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:56.322399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:56.323582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:56.346879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:56.390838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 565/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:53:56.671747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782648d6-e4c4-4ab1-84ac-f29c4ac50a93 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:56.687257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:56.774565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782648d6-e4c4-4ab1-84ac-f29c4ac50a93 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:56.807949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:56.808576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:56.808858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:56.809135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] PATH_INFO: `/v3/roles/a323cdc828c0456d85abdc6f384b9a94` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:56.810553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] RBAC: Authorizing `identity:get_role(role_id=a323cdc828c0456d85abdc6f384b9a94)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:56.811910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:56.813236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 561/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:56 2022] GET /identity/v3/roles/a323cdc828c0456d85abdc6f384b9a94 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:56.819621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:56.918883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d885268-9d7b-4c41-8629-df9144d4e21b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:56.953409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:56.953963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:56.954293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:56.954573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] PATH_INFO: `/v3/users/f330124aac404dc0b461f068521f816d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:56.955699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] RBAC: Authorizing `identity:get_user(user_id=f330124aac404dc0b461f068521f816d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:56.957234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:56.958862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 566/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:53:56 2022] GET /identity/v3/users/f330124aac404dc0b461f068521f816d => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:56.964731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:57.048684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:57.067409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b141d-a3d7-45b1-be35-9e8e3d87e960 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:57.101188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:57.101789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:57.102068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:57.102428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:57.168792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:57.170229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:57.248079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:57.266938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 562/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:53:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:53:57.272965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:57.300486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:57.372881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ae37-f5d1-48e8-a0ab-aef503098ead None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:57.406107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:57.406760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:57.407041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:57.407827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] PATH_INFO: `/v3/projects/4c3e38a88c444d57b555c6368d5a01af` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:57.408946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e38a88c444d57b555c6368d5a01af)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:57.410419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059f271-0a5e-4b3a-a819-e6b247f44fdb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:57.412038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 567/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:53:57 2022] GET /identity/v3/projects/4c3e38a88c444d57b555c6368d5a01af => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:57.418358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:53:57.514810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238325f-5ea7-4006-9ec0-37da9f9a89f1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:53:57.548633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:53:57.549231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:57.549508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:57.549781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:57.550526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] RBAC: Adding query filter params (role.id=a323cdc828c0456d85abdc6f384b9a94, scope.project.id=4c3e38a88c444d57b555c6368d5a01af, user.id=f330124aac404dc0b461f068521f816d) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:53:57.550830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:53:57.552249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a6e02-3c95-4c11-89a1-3cf1507f3eff None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:53:57.557934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 563/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:53:57 2022] GET /identity/v3/role_assignments?user.id=f330124aac404dc0b461f068521f816d&scope.project.id=4c3e38a88c444d57b555c6368d5a01af&role.id=a323cdc828c0456d85abdc6f384b9a94 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:53:59.756732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f6c7-f11f-43f8-86df-7637bcc9205a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:59.757254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f6c7-f11f-43f8-86df-7637bcc9205a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:59.757254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f6c7-f11f-43f8-86df-7637bcc9205a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:59.758624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 568/1131] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:53:59.763761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:53:59.764141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:53:59.764313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:53:59.782697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:53:59.783882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:53:59.824463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:53:59.849216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 564/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:00.126574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683f6c7-f11f-43f8-86df-7637bcc9205a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:00.227261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:00.239301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683f6c7-f11f-43f8-86df-7637bcc9205a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:00.273885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:00.274547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:00.274831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:00.275109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:00.276227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:00.277660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad859fdd-7080-45f9-b82d-c73e88a3a534 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:00.279272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 569/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:54:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:00.285129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:00.380532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89692a6b-f0d1-4994-8904-02c6e6a0d6ff None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:00.413072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:00.413667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:00.413942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:00.414212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:00.414878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:00.416278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95608bb0-d6e7-421d-a1fd-41191cc97874 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:00.443524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 565/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:54:00 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:54:02.633683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a2d6-c813-43a3-bccf-ca80db31a2a8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:02.634210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a2d6-c813-43a3-bccf-ca80db31a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:02.634383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a2d6-c813-43a3-bccf-ca80db31a2a8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:02.635796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 570/1135] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:02.641024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:02.641421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:02.641620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:02.659945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:02.661120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:02.683460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:02.730290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 566/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:03.002709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4a2d6-c813-43a3-bccf-ca80db31a2a8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:03.102854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4a2d6-c813-43a3-bccf-ca80db31a2a8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:03.135759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:03.136389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:03.136677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:03.136955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:03.138083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:03.139556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63cf2b-a962-4d8c-a9d7-28aa319d4db1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:03.141134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 571/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:54:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:03.147445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:03.245242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9ec8-40d2-4dc3-8e42-b85f1338069a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:03.278635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:03.279163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:03.279442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:03.279716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:03.280363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:03.281774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b8a0-08f0-40ee-9c61-e8778cdec8de None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:03.302443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 567/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:54:03 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:54:05.507347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2c9af-b646-4247-8104-9b70a2081cf6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:05.507876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2c9af-b646-4247-8104-9b70a2081cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:05.507876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2c9af-b646-4247-8104-9b70a2081cf6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:05.509198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 572/1139] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:05.514398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:05.514767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:05.514954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:05.533487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:05.534724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:05.543971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:05.601906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 568/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:05.878225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2c9af-b646-4247-8104-9b70a2081cf6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:05.910680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:05.981609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2c9af-b646-4247-8104-9b70a2081cf6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.014878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.015500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.015783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.016058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.026756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:06.031604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:06.033361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:06.034444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 573/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:06.039372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:06.136679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96a1dc-6189-49d3-a47e-5235c4535e42 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.177151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.177910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.178192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.178501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.179179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:06.179482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:06.180842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:06.189356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 569/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:06.195364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:06.286160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:06.295612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4726b-a012-412d-90b4-7df5da17562b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.328210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.328822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.329659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.329929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] PATH_INFO: `/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.342348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:06.344036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:06.345646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 574/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:06 2022] GET /identity/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:06.351450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:06.360411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:06.447039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7669af-9917-4f3e-9337-73f3b3e86744 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.479382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.479976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.480253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.480520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.550907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:06.552341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:06.559890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:06.648575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 570/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:54:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:54:06.654589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:06.754323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ac9d-626b-43e9-adea-5bc0cfbc6313 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.787188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.787805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.788081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.788352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] PATH_INFO: `/v3/projects/59b8455155854bcf988d5ddbf9f438b9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.789462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] RBAC: Authorizing `identity:get_project(project_id=59b8455155854bcf988d5ddbf9f438b9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:06.790916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45b377-0f1b-449c-95e1-79e060b66346 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:06.792526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 575/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:06 2022] GET /identity/v3/projects/59b8455155854bcf988d5ddbf9f438b9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:06.799356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:06.897168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b23eb6-a609-4d32-b075-365b5a52d9b9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:06.905053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:06.931979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:06.932579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:06.932857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:06.933130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:06.933846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=59b8455155854bcf988d5ddbf9f438b9, user.id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:06.934153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:06.935603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd71b-2bdc-4147-b83b-77f608d69f1a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:06.942030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 571/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:54:06 2022] GET /identity/v3/role_assignments?user.id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7&scope.project.id=59b8455155854bcf988d5ddbf9f438b9&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:09.071066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502c81-d7e4-416b-a19e-f70a5172df3a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:09.071568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502c81-d7e4-416b-a19e-f70a5172df3a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:09.071568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502c81-d7e4-416b-a19e-f70a5172df3a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:09.072858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 576/1147] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:09.078213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:09.078655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:09.079273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:09.098522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:09.099701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:09.165737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 572/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:09.430346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd502c81-d7e4-416b-a19e-f70a5172df3a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:09.448423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:09.531288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd502c81-d7e4-416b-a19e-f70a5172df3a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:09.564505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:09.565133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:09.565431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:09.565685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:09.575710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:09.581138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:09.582372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:09.583632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 577/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:09.588350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:09.682865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:09.685759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dca9e-de56-497d-a30c-7e3345e3e653 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:09.721022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:09.721626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:09.721905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:09.722178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:09.722872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:09.723175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:09.724529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:09.732386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 573/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:09.738954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:09.816688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:09.841008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc6c24-2d31-4619-b689-036347140f93 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:09.875487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:09.876661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:09.876939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:09.877208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] PATH_INFO: `/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:09.878362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:09.879789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:09.881349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 578/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:09 2022] GET /identity/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:09.887201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:09.986175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f332c-0dc8-48c1-ac2b-bb783877ee07 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:10.019438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:10.020070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:10.020349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:10.020620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] PATH_INFO: `/v3/projects/59b8455155854bcf988d5ddbf9f438b9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:10.021738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] RBAC: Authorizing `identity:get_project(project_id=59b8455155854bcf988d5ddbf9f438b9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:10.023187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194632-ee4d-43ab-8afe-411092d453a5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:10.024821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 574/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:09 2022] GET /identity/v3/projects/59b8455155854bcf988d5ddbf9f438b9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:10.031073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:10.128343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb2f5-533d-45af-a133-9033babb5220 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:10.167060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:10.167717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:10.167998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:10.168274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] PATH_INFO: `/v3/projects/59b8455155854bcf988d5ddbf9f438b9/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:10.170151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=59b8455155854bcf988d5ddbf9f438b9, user_id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:10.171614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3932-2029-4a8a-b8fb-9acebd838dd7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:10.187748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 579/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:54:10 2022] PUT /identity/v3/projects/59b8455155854bcf988d5ddbf9f438b9/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:54:12.333288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5373-bc90-4eee-9763-5ac04f474fe0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:12.333838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5373-bc90-4eee-9763-5ac04f474fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:12.333838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f5373-bc90-4eee-9763-5ac04f474fe0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:12.335252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 575/1154] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:12.340405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:12.340823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:12.340928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:12.348494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:12.359828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:12.361028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:12.426146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 580/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:12.695557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5373-bc90-4eee-9763-5ac04f474fe0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:12.725941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:12.799289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f5373-bc90-4eee-9763-5ac04f474fe0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:12.832841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:12.833460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:12.833735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:12.834003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:12.844342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:12.849094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:12.850170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:54:12.851087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 576/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:12.856539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:12.956868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2367ef-70b0-4369-b109-c0d686aa2b87 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:12.991051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:12.991656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:12.991941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:12.992215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:12.992882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:12.993191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:12.994757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:12.996177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:13.004515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 581/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:13.010540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:13.098168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:13.107772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375340-4987-47e9-8fb3-a905354895e0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:13.139982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:13.140602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:13.140877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:13.141147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] PATH_INFO: `/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:13.142269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:13.143699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:13.145259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 577/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:13 2022] GET /identity/v3/users/b6d1b4f7dd1a4b2ebb8f554f6f640ad7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:13.151120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:13.250559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be20a0-7af9-48bf-8f65-7860eac8bd91 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:13.285278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:13.285884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:13.286171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:13.286473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:13.351811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:13.362568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:13.364020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:13.460893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 582/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:54:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:54:13.467149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:13.566610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086df0f-cd5b-453e-b7e7-3bc08dd33c21 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:13.600483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:13.601105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:13.601378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:13.601646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] PATH_INFO: `/v3/projects/59b8455155854bcf988d5ddbf9f438b9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:13.602778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] RBAC: Authorizing `identity:get_project(project_id=59b8455155854bcf988d5ddbf9f438b9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:13.604191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759428e5-6bd9-4930-94ae-1d0493e168fb None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:13.605858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 578/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:13 2022] GET /identity/v3/projects/59b8455155854bcf988d5ddbf9f438b9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:13.613028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:13.713781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:13.720729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca21e7-26a5-4373-bce4-6baaa7582dc7 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:13.759957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:13.760566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:13.760845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:13.761118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:13.761843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=59b8455155854bcf988d5ddbf9f438b9, user.id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:13.762153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:13.763621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc26b2d-1c61-418e-8e75-0f9db7fedd0e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:13.770074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 583/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:54:13 2022] GET /identity/v3/role_assignments?user.id=b6d1b4f7dd1a4b2ebb8f554f6f640ad7&scope.project.id=59b8455155854bcf988d5ddbf9f438b9&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:15.975094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d1cb-362c-43e2-98ce-68258159a785 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:15.975617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d1cb-362c-43e2-98ce-68258159a785 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:15.975617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d1cb-362c-43e2-98ce-68258159a785 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:15.976904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 579/1162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:15.982129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:15.982558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:15.982700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:16.001618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:16.002857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:16.067978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 584/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:16.347182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d1cb-362c-43e2-98ce-68258159a785 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:16.374691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:16.452475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d1cb-362c-43e2-98ce-68258159a785 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:16.485345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:16.485946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:16.486222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:16.486519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:16.552949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:16.555136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:16.582639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:16.653230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 580/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:54:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:54:16.659942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:16.747672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:16.758082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01a5ba-bd98-47c9-91e7-bd88a5ffe2c2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:16.792465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:16.793087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:16.793364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:16.793632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:16.800140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:16.801571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-07bf563e-9a83-4ff4-af53-6b74faccefdb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:16.812779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:16.814532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:16.815618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 585/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:54:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:16.820470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:16.917515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491035-1d88-4e9e-b185-ab41351266bf None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:16.942752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:16.953086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:16.954232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:16.954545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:16.954819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:16.955458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:16.955763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:16.957119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76b3e-6c5b-4ad2-ae73-c5de0a963504 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:16.964251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 581/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Sep 21 09:54:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:19.132041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a582-eae5-46ab-ba2d-57f1124030e7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:19.132575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a582-eae5-46ab-ba2d-57f1124030e7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:19.132575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a582-eae5-46ab-ba2d-57f1124030e7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:19.133922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 586/1167] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:19.139176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c5a6-76e1-42d7-8b9b-965bea5ac099 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:19.139574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c5a6-76e1-42d7-8b9b-965bea5ac099 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:19.139725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c5a6-76e1-42d7-8b9b-965bea5ac099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:19.158287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-29f6c5a6-76e1-42d7-8b9b-965bea5ac099 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:19.159485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-29f6c5a6-76e1-42d7-8b9b-965bea5ac099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:19.223466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 582/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:19.490621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a582-eae5-46ab-ba2d-57f1124030e7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:19.590637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a582-eae5-46ab-ba2d-57f1124030e7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:19.623668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:19.624274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:19.624554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:19.624826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:19.626104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:19.627509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613a699-acdb-492f-9f09-dd695f8398f8 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:19.643099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 587/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Sep 21 09:54:19 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:54:21.833497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baa94-e600-4dcb-8d2d-08f91af2f136 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:21.834042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baa94-e600-4dcb-8d2d-08f91af2f136 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:21.834042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39baa94-e600-4dcb-8d2d-08f91af2f136 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:21.835410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 583/1170] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:21.840870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:21.841286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:21.841412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:21.860368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:21.861630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:21.864605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:21.928496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 588/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:22.198866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39baa94-e600-4dcb-8d2d-08f91af2f136 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:22.298801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39baa94-e600-4dcb-8d2d-08f91af2f136 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:22.318859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:22.332389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:22.333014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:22.333291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:22.333565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] PATH_INFO: `/v3/domains/ae3e3d899e9a4b07a461a27a7688e199` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:22.343904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae3e3d899e9a4b07a461a27a7688e199)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:22.345837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79d215-37d2-44a7-961f-46a6a9fda13a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:22.347439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 584/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Sep 21 09:54:22 2022] GET /identity/v3/domains/ae3e3d899e9a4b07a461a27a7688e199 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:22.353416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:22.450045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175232a7-1980-44e6-91d3-207cf58497e7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:22.484134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:22.484742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:22.485024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:22.485301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:22.485959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:22.487544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1bc8b-82f0-4420-8019-70068a751b84 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:22.498226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:22.514687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 589/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:54:22 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:54:24.701532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be102-2ca6-4c81-8c69-b5848df89385 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:24.702087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be102-2ca6-4c81-8c69-b5848df89385 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:24.702087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be102-2ca6-4c81-8c69-b5848df89385 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:24.703617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 585/1174] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:24.709081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:24.709544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:24.709647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:24.727837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:24.729024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:24.793814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 590/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:25.065063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3be102-2ca6-4c81-8c69-b5848df89385 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:25.163790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3be102-2ca6-4c81-8c69-b5848df89385 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:25.196409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:25.197037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:25.197316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:25.197589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] PATH_INFO: `/v3/domains/ae3e3d899e9a4b07a461a27a7688e199` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:25.198746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae3e3d899e9a4b07a461a27a7688e199)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:25.200200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f09aa-9f45-41cf-b6bd-3759f52b8669 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:25.201850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 586/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Sep 21 09:54:25 2022] GET /identity/v3/domains/ae3e3d899e9a4b07a461a27a7688e199 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:25.208030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:25.309316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e75e-e48f-4167-abf0-d5455814e160 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:25.331969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:25.344761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:25.345366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:25.345641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:25.345909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:25.346585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:25.348009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79088fe-402d-443d-bf2b-8d64fbe4b8f1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:25.368505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 591/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:54:25 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:54:27.538550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef8ae5-2a49-4e86-a145-f2d7897edf10 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:27.539126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef8ae5-2a49-4e86-a145-f2d7897edf10 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:27.539126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef8ae5-2a49-4e86-a145-f2d7897edf10 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:27.540429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 587/1178] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:27.545762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:27.546188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:27.546347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:27.564741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:27.565958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:27.631972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 592/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:27.904121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef8ae5-2a49-4e86-a145-f2d7897edf10 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:27.955167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:28.006527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef8ae5-2a49-4e86-a145-f2d7897edf10 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.038590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.039211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.039494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.039771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.050509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:28.055349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:28.056441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:54:28.057451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 588/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:28.062484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:28.157841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a950fa-af9c-4e0d-87e6-b280e038ae62 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.167031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:28.192628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.193284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.193509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.193781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.194493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:28.194793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:28.196159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:28.203850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 593/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:28.209784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:28.307542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f6859-674b-478b-88fe-5c7c3726ce46 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.316249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:28.340169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.340792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.341066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.341332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] PATH_INFO: `/v3/users/0cd8b22b382d4293842905c634641487` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.354941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd8b22b382d4293842905c634641487)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:28.356361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:28.357937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 589/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:28 2022] GET /identity/v3/users/0cd8b22b382d4293842905c634641487 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:28.364541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:28.461253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab60625-ba6d-4c69-bd30-1edca7de446b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.494281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.494881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.495157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.495428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.532978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:28.560411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:28.561843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:28.655828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 594/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:54:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:54:28.662359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:28.764541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f66-819a-40ce-ae0f-f09758ec7983 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.797451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.798074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.798376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.798645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] PATH_INFO: `/v3/projects/f5df475f7c72446090056c7c95b8a19b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.799729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] RBAC: Authorizing `identity:get_project(project_id=f5df475f7c72446090056c7c95b8a19b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:28.801144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bce4f-5463-4400-9aa4-3e002b1dc6ea None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:28.802785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 590/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:28 2022] GET /identity/v3/projects/f5df475f7c72446090056c7c95b8a19b => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:28.809100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:28.876629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:28.909266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8182e-7b8e-4b94-9fe5-43858dd707f4 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:28.942519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:28.943123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:28.943401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:28.943672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:28.944387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=f5df475f7c72446090056c7c95b8a19b, user.id=0cd8b22b382d4293842905c634641487) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:28.944697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:28.946134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f39-aa3a-410d-a7ce-cbbd4f4c768a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:28.951609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 595/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:54:28 2022] GET /identity/v3/role_assignments?user.id=0cd8b22b382d4293842905c634641487&scope.project.id=f5df475f7c72446090056c7c95b8a19b&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:31.101419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abc5b-e4f7-466a-9709-5c0ca8df3b68 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:31.101915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abc5b-e4f7-466a-9709-5c0ca8df3b68 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:31.101915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abc5b-e4f7-466a-9709-5c0ca8df3b68 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:31.103234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 591/1186] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:31.108585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:31.108953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:31.109133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:31.127587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:31.128774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:31.194399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 596/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:31.478992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3abc5b-e4f7-466a-9709-5c0ca8df3b68 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:31.513945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:31.579143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3abc5b-e4f7-466a-9709-5c0ca8df3b68 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:31.613178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:31.613803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:31.614080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:31.614380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:31.624098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:31.629495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:31.630668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:54:31.631775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 592/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:31.637950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:31.699945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:31.738702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a794c8-2f4a-4781-ae3e-c8e3c958e1ad None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:31.772029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:31.772636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:31.772914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:31.773182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:31.773841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:31.774140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:31.775546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:31.784158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 597/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:31.789967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:31.880120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:31.886998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fac8b-1d5b-4352-a0fb-55c58761d354 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:31.919498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:31.920121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:31.920401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:31.920673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] PATH_INFO: `/v3/users/0cd8b22b382d4293842905c634641487` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:31.921774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd8b22b382d4293842905c634641487)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:31.923757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:31.925329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 593/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:31 2022] GET /identity/v3/users/0cd8b22b382d4293842905c634641487 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:31.931161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:32.033830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704e757-b0d6-483e-890d-410429dc8cd9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:32.061235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:32.070067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:32.070725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:32.071004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:32.071276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] PATH_INFO: `/v3/projects/f5df475f7c72446090056c7c95b8a19b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:32.072372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] RBAC: Authorizing `identity:get_project(project_id=f5df475f7c72446090056c7c95b8a19b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:32.073794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4678-b312-4cee-9cf9-e8d94661e081 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:32.075449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 598/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:31 2022] GET /identity/v3/projects/f5df475f7c72446090056c7c95b8a19b => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:32.081500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:32.186991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd0e7-4d70-41c2-adf3-4414cd7c9de4 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:32.220995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:32.221652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:32.221926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:32.222195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] PATH_INFO: `/v3/projects/f5df475f7c72446090056c7c95b8a19b/users/0cd8b22b382d4293842905c634641487/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:32.224138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] RBAC: Authorizing `identity:create_grant(project_id=f5df475f7c72446090056c7c95b8a19b, user_id=0cd8b22b382d4293842905c634641487, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:32.225562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48136c-6490-4a4e-8322-b68a6dc4c9df None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:32.238398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 594/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:54:32 2022] PUT /identity/v3/projects/f5df475f7c72446090056c7c95b8a19b/users/0cd8b22b382d4293842905c634641487/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:54:34.369316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c97d6-58f6-4703-912b-977b2cf44ec4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:34.369865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c97d6-58f6-4703-912b-977b2cf44ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:34.369865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c97d6-58f6-4703-912b-977b2cf44ec4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:34.371222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 599/1193] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:54:34.376564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:34.376978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:34.377117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:34.395415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:54:34.396611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:54:34.413075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:34.463234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 595/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:54:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:54:34.736292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c97d6-58f6-4703-912b-977b2cf44ec4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:34.835063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c97d6-58f6-4703-912b-977b2cf44ec4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:34.868086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:34.868721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:34.869003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:34.869287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:34.880291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:54:34.885125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:54:34.886211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:54:34.887131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 600/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:54:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:54:34.893071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:34.993122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430546-4f2a-4ee1-a40f-62692f484388 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:35.026551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:35.027156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:35.027436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:35.027711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:35.028371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:35.028674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:35.030032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:35.038008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 596/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:35.044157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:35.101289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:35.145881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd1b3-0180-49f4-8b9b-8c9adb9506eb None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:35.179461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:35.180079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:35.180354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:35.180623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] PATH_INFO: `/v3/users/0cd8b22b382d4293842905c634641487` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:35.181720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd8b22b382d4293842905c634641487)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:35.183176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:35.184726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 601/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Sep 21 09:54:35 2022] GET /identity/v3/users/0cd8b22b382d4293842905c634641487 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:35.191182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:35.206932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:35.289339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43cd8-6c5a-4064-aba3-2f125dffd734 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:35.322037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:35.322659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:35.322941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:35.323213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:35.387549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:35.388981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:35.403407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:35.491994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 597/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:54:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:54:35.498022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:35.600545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058798f5-1c7c-4cd5-b03d-259076a1d400 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:35.624246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:35.636274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:35.636912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:35.637191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:35.637469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] PATH_INFO: `/v3/projects/f5df475f7c72446090056c7c95b8a19b` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:35.638630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] RBAC: Authorizing `identity:get_project(project_id=f5df475f7c72446090056c7c95b8a19b)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:35.640081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029d136-c849-41c7-b166-e0bcee8cc733 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:35.641763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 602/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Sep 21 09:54:35 2022] GET /identity/v3/projects/f5df475f7c72446090056c7c95b8a19b => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:35.647981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:54:35.747559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f388-8b7c-421d-b5e7-ff94455d5508 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:54:35.761590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:35.781965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:54:35.782595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:54:35.782875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:54:35.783146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:54:35.783859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=f5df475f7c72446090056c7c95b8a19b, user.id=0cd8b22b382d4293842905c634641487) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:54:35.784168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:54:35.785569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a829c-a2da-4d4c-aef6-2a783b62bafc None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:54:35.791242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 598/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:54:35 2022] GET /identity/v3/role_assignments?user.id=0cd8b22b382d4293842905c634641487&scope.project.id=f5df475f7c72446090056c7c95b8a19b&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:54:45.631981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:54:45.788621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=11 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:32.784414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b63e-1514-4049-b19a-e2f73fb977f2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:32.784987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b63e-1514-4049-b19a-e2f73fb977f2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:32.784987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0b63e-1514-4049-b19a-e2f73fb977f2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:32.786330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 603/1201] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:55:32.792414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:32.792921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:32.793028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:32.813214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:32.814701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:55:32.901068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 599/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:55:33.189112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0b63e-1514-4049-b19a-e2f73fb977f2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:33.315186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0b63e-1514-4049-b19a-e2f73fb977f2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:33.367894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:33.368539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:33.368962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:33.369273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:33.382959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:33.384807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:33.402338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:33.407546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:33.408562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:33.408562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:33.408562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:33.408562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 604/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:33.410088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:33.545445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16abbc7-8dc8-49bc-9a52-803c5c61d426 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:33.586622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:33.596619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:33.597535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:33.598057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:33.598614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:33.599450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:33.600123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:33.601535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde40c8c-02f1-48f9-a562-18b0d5fa5a3a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:33.621207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:33.625822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 600/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:33.688981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:33.761581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d2c35-8222-403a-b723-4f9aa9a51d34 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:33.806294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:33.806294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:33.807145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:33.807145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:33.807630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:33.809260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302653-d994-4065-963b-cb44bb3d10ca None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:33.850671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 605/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Sep 21 09:55:33 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:55:36.360272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc900ca-18d4-4046-891e-a4efb58f4b38 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:36.361109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc900ca-18d4-4046-891e-a4efb58f4b38 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:36.361109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc900ca-18d4-4046-891e-a4efb58f4b38 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:36.362609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 601/1206] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:55:36.368558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:36.369376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:36.369376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:36.398545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:36.402116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:55:36.534481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 606/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:55:36.933785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc900ca-18d4-4046-891e-a4efb58f4b38 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:37.110223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc900ca-18d4-4046-891e-a4efb58f4b38 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:37.153708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:37.155247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:37.155665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:37.156093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:37.171404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:55:37.178370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:37.180263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:37.181419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 602/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:55:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:37.189559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:37.258538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:37.375852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bcf19-a689-4fc4-be2c-b9776351f5bd None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:37.445549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:37.446610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:37.447095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:37.447560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:37.448551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:37.449072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:37.451504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:37.466579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 607/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:37.475462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:37.562438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:37.658100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b4ce-4d46-40bc-a018-94ed38436d6d None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:37.724070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:37.724769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:37.725141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:37.725415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:37.745926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:37.749986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:37.781832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:37.783200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:37.784167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:37.784167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:37.784167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:37.784167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 603/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:37.796186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:37.981646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:37.986166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b8cc3-5514-4569-84b1-d66db6afc695 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:38.044214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45779a32-7196-4e80-8650-16623347820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:38.044966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779a32-7196-4e80-8650-16623347820e None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:38.046008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779a32-7196-4e80-8650-16623347820e None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:38.046476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779a32-7196-4e80-8650-16623347820e None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:38.047157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45779a32-7196-4e80-8650-16623347820e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:38.047527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45779a32-7196-4e80-8650-16623347820e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:38.049364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45779a32-7196-4e80-8650-16623347820e None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:38.066618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 608/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:38.073281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:38.261809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed113e-5ca5-44f1-9eaf-fb180632da72 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:38.261809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:38.329396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:38.331055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:38.332609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:38.332609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:38.343541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:38.346215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:55:38.368436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:38.370903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:38.372987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:38.378958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 604/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:38.382781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45779a32-7196-4e80-8650-16623347820e None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:38.586553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45779a32-7196-4e80-8650-16623347820e None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:38.660072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:38.661319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:38.663113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:38.663719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:38.665825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:38.666540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:38.669405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:38.709036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 609/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:55:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:38.717972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:38.892622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140677-acfc-473a-86aa-38c61c92845c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:38.953749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:38.954490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:38.954778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:38.955073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:39.003701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:39.075815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:39.079240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:39.320589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 605/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:55:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 09:55:39.322596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:39.361280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:39.493945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b52e3e-8422-425e-94a1-7884d81efeb6 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:39.541347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:39.542165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:39.542533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:39.542802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:39.560047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:39.561768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:39.581222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:39.582797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:39.583885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:39.583885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:39.583885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:39.590282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 610/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:39.590470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:39.684597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:39.751457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8f02-1fee-45d2-b147-14322029e025 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:39.796458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:39.797089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:39.797371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:39.797674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:39.798375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:39.798688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:39.800064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:39.813093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 606/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:39.819388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:39.913538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:39.955313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe7d7-026a-4db9-9072-6a5ef4bc1dd2 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:40.000483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:40.001591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:40.002191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:40.002682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:40.015563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:40.018611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:55:40.038628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:40.039971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:40.041123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:40.043205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 611/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:40.052258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:40.213924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41b23-80c9-4455-a526-78c6259eca5e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:40.245407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:40.267425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:40.268160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:40.268448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:40.268732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:40.269629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:40.270008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:40.271938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1341d8-a214-49b5-88d6-098d2d63fb7a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:40.290754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 607/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:40.298313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:40.461014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f794-2d03-4cc4-b875-282f3fa8ed43 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:40.499008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:40.507526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:40.508587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:40.509062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:40.509566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:40.511016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d16e15230c59475eba52906ad0643fe1) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:40.511593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:40.513877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab325c-efef-46ee-82e0-9aa79c8186ae None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:40.538286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 612/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:55:40 2022] GET /identity/v3/role_assignments?user.id=d16e15230c59475eba52906ad0643fe1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:42.853178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0469-f900-4dbf-b357-f526a998a5fe None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:42.854081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0469-f900-4dbf-b357-f526a998a5fe None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:42.854081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0469-f900-4dbf-b357-f526a998a5fe None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:42.855519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 608/1220] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:55:42.861859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:42.862842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:42.862842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:42.889480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:42.891032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:55:43.003258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 613/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:55:43.321308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0469-f900-4dbf-b357-f526a998a5fe None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:43.482141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0469-f900-4dbf-b357-f526a998a5fe None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:43.539182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:43.539522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:43.539745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:43.540025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:43.553949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:55:43.559130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:43.561547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:43.563306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 609/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:43.566984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:43.710196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28e4b8-eb66-4be0-9a24-51be77353b7d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:43.744058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:43.758481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:43.759141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:43.759426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:43.759703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:43.760584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:43.761014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:43.762697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:43.773915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 614/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:43.784352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:43.851484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:43.917646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359d95-569b-4c0f-8230-8ef5d1d9eccc None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:43.959087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:43.959694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:43.960011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:43.960363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:43.972224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:43.973734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:43.991369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:43.993500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:43.995476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:43.995476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:43.995476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:43.995476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 610/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:44.000209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:44.132569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb64a8-eeeb-4427-884c-3529c4829aa9 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:44.175153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:44.176080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:44.176551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:44.177044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:44.178229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:44.178802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:44.181221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:44.202436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 615/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:44.208780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:44.337676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:44.348341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a604d-6ab5-47dc-8072-16bc7631ab1c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:44.396666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:44.397580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:44.397910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:44.398298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:44.407790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:44.409294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:55:44.424151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:44.425716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:44.427567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 611/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:44.431913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:44.491008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:44.569894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c4a2-8c5d-49a4-ae0e-4668b7b2da02 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:44.608413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:44.609159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:44.609535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:44.609827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:44.610735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:44.611200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:44.612693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:44.638366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 616/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:55:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:44.648041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:44.773791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40d039-b562-4c44-bcdd-4a0aea33e81b None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:44.820608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:44.821343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:44.821643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:44.821912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:44.838509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:44.840244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:44.857264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:44.859679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:44.860771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:44.860771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:44.860771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:44.860771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 612/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:44.865033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:44.996308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046491f-57a0-488d-b1aa-b1277d101647 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:44.999534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:45.041295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:45.042295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:45.042582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:45.042855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:45.043555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:45.043855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:45.046145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:45.062403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 617/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:45.069947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:45.081894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:45.230469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb086e-f76c-4374-81f3-111ecab25a20 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:45.288170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:45.288870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:45.289241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:45.289467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:45.299819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:45.301477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:55:45.316049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:45.317379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:45.318803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 613/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:55:45.324118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:45.459572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594a71-6999-4c6c-b36a-715e5ce70eef None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:45.504958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:45.505888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:45.506407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:45.506879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:45.508313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:45.508797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:45.510523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2ebbd-a6ab-42bc-b893-8c650de132e0 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:45.524548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 618/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:45.532018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:45.632505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:45.685876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6512-33ce-42f3-8964-9d398e18c446 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:45.728811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:45.729524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:45.729887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:45.730110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d16e15230c59475eba52906ad0643fe1/roles/2e8b89a267e94b36953f502498800222` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:45.749733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=d16e15230c59475eba52906ad0643fe1, role_id=2e8b89a267e94b36953f502498800222)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:45.751889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d046aa-dfc6-4acc-bb0d-0351d326aa2b None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:45.770157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 614/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:55:45 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d16e15230c59475eba52906ad0643fe1/roles/2e8b89a267e94b36953f502498800222 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:55:48.225869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a97e2-6818-4f11-a349-e3f6c6507013 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:48.226532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a97e2-6818-4f11-a349-e3f6c6507013 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:48.226680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a97e2-6818-4f11-a349-e3f6c6507013 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:48.228568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 619/1233] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:55:48.235630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:48.236297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:48.236297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:48.267492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:48.268943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:55:48.368432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 615/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 09:55:48.660575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a97e2-6818-4f11-a349-e3f6c6507013 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:48.698906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:48.817567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a97e2-6818-4f11-a349-e3f6c6507013 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:48.861177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:48.861909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:48.862213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:48.862528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:48.877742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:55:48.883873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:48.885806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:48.887650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 620/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Sep 21 09:55:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:48.893195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:48.973451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:49.058411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479b314-3f67-4d62-bda5-ed6fde5024cd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:49.100416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:49.101458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:49.101963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:49.102485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:49.103393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:49.103734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:49.105171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:49.115923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 616/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Sep 21 09:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:49.122702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:49.250967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:49.278974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922ba44-6c61-4395-b2e8-cf136e6cfb0b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:49.327926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:49.328713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:49.329007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:49.329278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:49.342838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:49.346520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:49.370664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:49.371940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:49.373127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:49.373127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:49.373127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:49.373127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 621/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:49.379640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:49.508799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef165087-d1a7-458a-ad82-158ba7badd30 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:49.524183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:49.554378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:49.555074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:49.555629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:49.555947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:49.556745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:49.557157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:49.558881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:49.573419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 617/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:49.580673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:49.699779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e6687-7ac0-4e61-afb2-6c45155b0f08 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:49.767038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:49.768333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:49.769023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:49.769628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:49.774069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:49.780870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:49.783150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:55:49.798572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:49.800656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:49.802626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 622/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:49.806258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:49.937932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e8f7-e9cf-4210-98c4-2afbad111f86 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:49.981022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:49.982484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:49.982905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:49.983193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:49.984130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:49.984690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:49.986288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:50.010292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 618/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:55:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:50.018551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:50.141086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5400da3-acc7-4c4e-b4c7-a314f417f643 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:50.196329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:50.197007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:50.197366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:50.197735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:50.299939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:50.307630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:50.309120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:50.454637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 623/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:55:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:55:50.464122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:50.505446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:50.620233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ca671-53b1-4ea8-ae4e-5c2b409bccf0 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:50.679617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:50.680268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:50.680536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:50.680892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:50.693712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:50.696684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:50.718350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:50.720821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:50.722054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:50.722054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:50.722054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:50.722054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 619/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:50.727865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:50.876381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:50.883530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361669-6b30-408c-94ae-3d275ed9bac1 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:50.943347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:50.944363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:50.944839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:50.945318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:50.946297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:50.946618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:50.948104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:50.966184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 624/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:50.973379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:51.075808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:51.109856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abff86-587d-4510-a4ab-35dfbeeebb8e None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:51.152547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:51.153105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:51.153389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:51.153658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:51.162048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:51.163634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:55:51.178787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:51.181867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:51.183922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 620/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:51.187940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:51.328127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b03b-b953-41e3-907e-6fc4b4d69746 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:51.371364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:51.372153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:51.372466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:51.373457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:51.374293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:51.374755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:51.376549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28123f4-0893-4fd8-ad29-723a2004169c None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:51.393280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 625/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:51.402166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:51.527593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440bedb-eecc-4abc-987d-64a7da5acc60 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:51.564436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:51.565192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:51.565470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:51.565805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:51.566762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] RBAC: Adding query filter params (role.id=2e8b89a267e94b36953f502498800222, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d16e15230c59475eba52906ad0643fe1) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:51.567206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:51.568791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010552-4047-4220-963d-7e83ff2b7ced None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:51.575349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 621/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:55:51 2022] GET /identity/v3/role_assignments?user.id=d16e15230c59475eba52906ad0643fe1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=2e8b89a267e94b36953f502498800222 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:54.289336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89a4d-6999-47b1-a196-8a6225ac9413 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:54.289949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89a4d-6999-47b1-a196-8a6225ac9413 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:54.289949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89a4d-6999-47b1-a196-8a6225ac9413 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:54.291422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 626/1247] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:55:54.299166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:54.299786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:54.300257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:54.312875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:54.330062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:54.331327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:55:54.416503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 622/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:55:54.696577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89a4d-6999-47b1-a196-8a6225ac9413 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:54.718288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:54.827006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89a4d-6999-47b1-a196-8a6225ac9413 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:54.872859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:54.873872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:54.874310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:54.874706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:54.892125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:55:54.899436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:54.900676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:54.907555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 627/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:54.908789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:55.061556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfbc17-bca2-46d5-a124-20ca89d34c35 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:55.112866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:55.121272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:55.122216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:55.123311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:55.123798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:55.125105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:55.125556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:55.127972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:55.139854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 623/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:55.150655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:55.250426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:55.281148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77e0e-db46-414c-9bd0-c4c78d47c4ae None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:55.346126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:55.347204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:55.347518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:55.347882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:55.361889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:55.363459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:55.385709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:55.387197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:55.398739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:55.398739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:55.398739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:55.398739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 628/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:55.398986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:55.544480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5101f-8a4a-4da0-b964-c69b64b21243 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:55.593191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:55.593853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:55.594176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:55.594813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:55.595490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:55.595860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:55.597412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:55.612923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 624/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:55.619489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:55.765650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c414-5559-447d-8d1e-db100b932617 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:55.804825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:55.815827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:55.816664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:55.816983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:55.817283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:55.827151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:55.829012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:55:55.843839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:55.845709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:55:55.847482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 629/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:55:55.853708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:55.921420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:55.974077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b33be5-02cd-477a-8e2d-7ef95892e093 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:56.021053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:56.021727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:56.022000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:56.022314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:56.023058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:56.023466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:56.024987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:56.055868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 625/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:55:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:55:56.063427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:56.198816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc22af-eef1-4953-a629-494d5b7e2106 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:56.241499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:56.242231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:56.242534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:56.242902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:56.317764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:56.340255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:56.343855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:56.496311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 630/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:55:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:55:56.503645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:56.642091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e4078-5ae0-4206-9413-f51dbc099ae5 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:56.661351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:56.692341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:56.693376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:56.693868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:56.694340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:56.714349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:56.716344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:55:56.739384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:56.741150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:55:56.742313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:55:56.742313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:55:56.742313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:56.742313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 626/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:56.749053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:56.862163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:56.878038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842aff-6558-4349-9b5e-758aa0de093f None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:56.925640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:56.926197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:56.926558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:56.926933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:56.927821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:56.928141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:56.929856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:56.945084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 631/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:56.951852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:57.090986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eaaab-2c51-4c10-be2c-aadca5f73b4c None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:57.128306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:57.128947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:57.129228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:57.129504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:57.136773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:57.138526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:55:57.152056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:55:57.153515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:55:57.154579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 627/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:55:57.160204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:57.319983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85952-5111-4350-a78d-ffd9ff767637 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:57.365065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:57.365627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:57.365934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:57.366309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:57.367180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:57.367610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:57.369326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f38a-feb2-48fe-b4aa-89561bd12b9a None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:57.385154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 632/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:57.392354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:55:57.422331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:55:57.519477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcd6e-cacb-4def-93bb-313ea6014016 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:55:57.564099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:55:57.564933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:57.565310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:57.565600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:57.566485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d16e15230c59475eba52906ad0643fe1) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:55:57.567109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:55:57.569013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bd4ce-0d18-4e0d-a402-e1dc25d80a43 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:55:57.590666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 628/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:55:57 2022] GET /identity/v3/role_assignments?user.id=d16e15230c59475eba52906ad0643fe1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:55:59.952401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c02d3-f0b9-42b5-86ba-4ff7e0842290 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:59.952998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c02d3-f0b9-42b5-86ba-4ff7e0842290 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:59.952998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c02d3-f0b9-42b5-86ba-4ff7e0842290 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:59.954474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 633/1261] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:55:59.962485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:55:59.963004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:55:59.963094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:55:59.990394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:55:59.992242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:00.067693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 629/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:55:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:00.338623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c02d3-f0b9-42b5-86ba-4ff7e0842290 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:00.352708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:00.454658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c02d3-f0b9-42b5-86ba-4ff7e0842290 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:00.490577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:00.491224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:00.491550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:00.491781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:00.503001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:56:00.507965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:00.509109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:00.510155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 634/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:56:00.515656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:00.535902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:00.631598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92298-d71d-4856-a8d4-04e3b7f94ea5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:00.673703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:00.674418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:00.674712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:00.675169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:00.675893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:00.676246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:00.677770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:00.686994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 630/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:00.693009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:00.772138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:00.817048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d5af-58d7-4aeb-80a6-a12a59caf2f8 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:00.853376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:00.854010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:00.854323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:00.854601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:00.869341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:00.871200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:56:00.889423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:00.890629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:56:00.891665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:56:00.891665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:00.891665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:00.891665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 635/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:00.896505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:00.981643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:01.002785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfb303-364a-4b62-a474-fdf28367c66f None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.038224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.038856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.039132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.039398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:01.040034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:01.040352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:01.041699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:01.054031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 631/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:01.059758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:01.181516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d85774-965c-4c5d-8a7d-b5ac250d7192 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.204575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:01.228929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.229688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.230026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.230352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:01.239497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:01.241244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:56:01.258030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:01.259350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:01.260320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 636/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:01.267665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:01.384331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607af43-0b24-493e-b3e5-b0d5094baee1 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.423538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.424145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.424468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.424748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:01.425548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:01.425855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:01.427375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:01.437487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:01.450692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 632/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:56:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:01.461509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:01.585265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d6c0-9e6f-4055-bd20-9080a1ddf234 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.624005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.624650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.624934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.625207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:01.638179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:01.639740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:56:01.657301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:01.659199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:56:01.660264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:56:01.660264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:01.660264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:01.660264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 637/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 09:56:01.666689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:01.778282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911398e-6225-40e2-9e6c-ede8162a1444 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.819663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.820279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.820558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.820832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:01.821478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:01.821782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:01.823171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:01.835298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 633/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:56:01.841759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:01.879070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:01.955524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76faa16-b120-4593-987a-8a6bae724b68 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:01.991128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:01.991838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:01.992114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:01.992383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:02.000419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:02.001915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:56:02.016100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:02.017310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:02.018513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 638/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:02.023648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:02.089212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:02.139461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5addaeb-d3b6-4933-b77c-b361fd04c215 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:02.178055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:02.178707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:02.178989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:02.179264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:02.179958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:02.180265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:02.181859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a1a17-2a7e-445e-a5ba-c71b31f7373f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:02.195705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 634/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:02.203129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:02.322767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:02.335053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dc523-0d7c-4c98-a484-d1d90059b47b None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:02.375587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:02.376343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:02.376678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:02.377008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] PATH_INFO: `/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d16e15230c59475eba52906ad0643fe1/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:02.379166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac10ab875b0e461494d906123bab7ede, user_id=d16e15230c59475eba52906ad0643fe1, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:02.380705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d376b-54b6-46bb-ac7b-9ec1f3ea46c4 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:02.395475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 639/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Sep 21 09:56:02 2022] PUT /identity/v3/projects/ac10ab875b0e461494d906123bab7ede/users/d16e15230c59475eba52906ad0643fe1/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 09:56:04.716136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331fe0-8cc8-45c5-8b2d-79fb3e7def69 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:04.716740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331fe0-8cc8-45c5-8b2d-79fb3e7def69 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:04.716740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331fe0-8cc8-45c5-8b2d-79fb3e7def69 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:04.718095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 635/1274] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:56:04.724288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:04.724808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:04.724932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:04.745500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:56:04.746772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:04.822788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 640/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:56:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:05.096560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2331fe0-8cc8-45c5-8b2d-79fb3e7def69 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.204770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2331fe0-8cc8-45c5-8b2d-79fb3e7def69 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:05.222585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:05.239005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:05.239630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:05.239908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:05.240180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:05.250583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 09:56:05.255450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:05.256624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:05.257613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 636/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:05.263943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.357918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:05.376234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7dd37-d3c1-4130-aebf-0128d28459b6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:05.410454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:05.411063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:05.411343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:05.411620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:05.412288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:05.412595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:05.413971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:05.422015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 641/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:05.427986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.551895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0503f-db78-40be-b9cc-f29434a1d6b9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:05.587845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:05.588506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:05.588785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:05.589055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:05.600164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:05.601629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:56:05.617626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:05.618835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:56:05.620116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:56:05.620116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:05.620116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:05.620116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 637/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:05.625140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.737457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b423aa-29b4-464b-9f11-593d644ff856 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:05.771388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:05.771989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:05.772274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:05.772552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:05.773189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:05.773493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:05.774895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:05.786376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 642/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:05.792123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.823257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:05.892832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267986-fcd7-4e30-a246-7916265ab12a None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:05.926020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:05.926680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:05.926963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:05.927240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:05.934617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:05.936615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 09:56:05.947792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:05.948948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:05.950106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 638/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:05.954965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:05.958711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:06.055014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056035-c1db-4ed9-b968-303de9046cee None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:06.087450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:06.088044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:06.088320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:06.088586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:06.089294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:06.089590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:06.091025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:06.108487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 643/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Sep 21 09:56:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:06.114267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:06.205482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:06.215185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4b7cb-e9f7-43cd-b4b3-6bda7bebe3db None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:06.250158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:06.250798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:06.250945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:06.251136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:06.322782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:06.324264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:06.424451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:06.435050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 639/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Sep 21 09:56:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 09:56:06.440882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:06.500129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:06.537998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb7fc-9aa7-4ad1-b4e2-a417d27d8b35 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:06.571255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:06.571878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:06.572161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:06.572434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:06.582086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:06.583562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 09:56:06.598630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:06.599747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 09:56:06.601059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 09:56:06.601059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 09:56:06.601059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:06.601059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 644/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 09:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:06.605522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:06.715245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9130d-d31b-42d8-a9cf-0ebacb112008 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:06.750003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:06.750683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:06.750906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:06.751179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:06.751807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:06.752106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:06.753451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:06.764275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 640/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Sep 21 09:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:06.770001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:06.868148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301563c-7364-49ea-b9c0-e077b9361866 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:06.881706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:06.901344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:06.901968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:06.902266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:06.902557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:06.909011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:06.910487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 09:56:06.921962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:06.923054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: ERROR keystone.server.flask.application Sep 21 09:56:06.924169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 645/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Sep 21 09:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:06.928958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:06.977028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:07.027099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368d97-7f70-49eb-808b-ae552d8e88d7 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:07.060165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:07.060756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:07.061032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:07.061303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:07.061978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:07.062304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:07.063711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eefeba-0425-4611-81ce-3b029d5acc17 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:07.075099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 641/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Sep 21 09:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:07.081160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:07.180969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d999aaa-acb2-4abc-acfd-a94edb4d5537 None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:07.213768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:07.214400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:07.214680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:07.214953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:07.215671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] RBAC: Adding query filter params (role.id=501008bc08bd430ea940373b81e53c53, scope.project.id=ac10ab875b0e461494d906123bab7ede, user.id=d16e15230c59475eba52906ad0643fe1) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:07.215979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:07.217925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ed73-e578-4b77-8233-9727668d0b57 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:07.223869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 646/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Sep 21 09:56:07 2022] GET /identity/v3/role_assignments?user.id=d16e15230c59475eba52906ad0643fe1&scope.project.id=ac10ab875b0e461494d906123bab7ede&role.id=501008bc08bd430ea940373b81e53c53 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:09.408672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bdc5-338b-4824-a4f4-ca28accbc917 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:09.409209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bdc5-338b-4824-a4f4-ca28accbc917 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:09.409209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bdc5-338b-4824-a4f4-ca28accbc917 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:09.410624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 642/1288] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:56:09.415895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:09.416345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:09.416437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:09.434540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:56:09.436229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:09.466103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:09.504834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 647/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:56:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:09.788726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35bdc5-338b-4824-a4f4-ca28accbc917 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:09.898201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35bdc5-338b-4824-a4f4-ca28accbc917 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:09.910291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:09.935989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:09.936629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:09.936908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:09.937184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:09.937776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:09.939184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:09.951975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:09.953262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:09.954334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 643/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:56:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:09.959166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:10.056666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8aa4b-7c3a-4982-b8e2-aff6eb08546f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:10.090025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:10.090669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:10.090954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:10.091762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:10.092391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:10.092696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:10.094069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9d113-4b17-404c-833c-2e59e714bc80 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:10.099243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 648/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 21 09:56:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:10.105087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:10.202046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c25f-ae4c-437e-9ad0-06841fe42dba None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:10.235485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:10.236014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:10.236289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:10.236558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] PATH_INFO: `/v3/services` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:10.237174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:10.237474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:10.238856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84709d-c0cf-4750-8992-dfaa20ecac8a None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:10.243276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 644/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 21 09:56:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 09:56:12.387409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0418-d9e4-4860-a1ce-0ff47bd54cbb None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:12.388778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0418-d9e4-4860-a1ce-0ff47bd54cbb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:12.388778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0418-d9e4-4860-a1ce-0ff47bd54cbb None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:12.389868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 649/1293] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:56:12.395364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa13a-f914-4d29-a2b0-fa87561ac36c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:12.395812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa13a-f914-4d29-a2b0-fa87561ac36c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:12.395907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa13a-f914-4d29-a2b0-fa87561ac36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:12.413830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-efdaa13a-f914-4d29-a2b0-fa87561ac36c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:56:12.415044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-efdaa13a-f914-4d29-a2b0-fa87561ac36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:12.443798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:12.482219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 645/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:56:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:12.750710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b0418-d9e4-4860-a1ce-0ff47bd54cbb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:12.785228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:12.867065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b0418-d9e4-4860-a1ce-0ff47bd54cbb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:12.907529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:12.908287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:12.908740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:12.909408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:12.909771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:12.911928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82ef4-95e3-4f37-bedb-9e7fb4f9ad6d None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:12.928361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 650/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Sep 21 09:56:12 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 09:56:15.163793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9443-dfc4-4c6e-9897-cab481b1dcaf None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:15.164352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9443-dfc4-4c6e-9897-cab481b1dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:15.164352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9443-dfc4-4c6e-9897-cab481b1dcaf None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:15.165679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 646/1296] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:56:15.171874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:15.172299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:15.172418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:15.190559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:56:15.191730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:15.262562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 651/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:56:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:15.531342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf9443-dfc4-4c6e-9897-cab481b1dcaf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:15.633517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf9443-dfc4-4c6e-9897-cab481b1dcaf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:15.669686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:15.670339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:15.670621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:15.670890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:15.671462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:15.672812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:15.681439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:15.686524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:15.687662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 647/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:56:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:15.689233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:15.707963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:15.789391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f313a-091e-4b04-91bc-b1ea7619848c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:15.822449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:15.823050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:15.823329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:15.823603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:15.824233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:15.824534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:15.826532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:15.831460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 652/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 21 09:56:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:15.837463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:15.868636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:15.938068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4041f0-82e8-483f-b95d-eb596fb8fbc2 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:15.971922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:15.972526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:15.972807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:15.973091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:15.973786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] RBAC: Adding query filter params (interface=public, service_id=f57fc52d2f9b40be95cecc90a7ea8513, region_id=RegionOne) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:15.974093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:15.975483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e27d1e-52da-4d76-9356-7e92ab2c1b1f None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:15.980361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 648/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Sep 21 09:56:15 2022] GET /identity/v3/endpoints?service_id=f57fc52d2f9b40be95cecc90a7ea8513&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:15.986054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:16.066278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:16.084904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331440-4c73-40cb-89e0-0df829bd1daa None admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:16.117915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:16.118564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:16.118849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:16.119154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:16.119763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:16.121137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20793f63-d2ef-421c-bc9c-e7e358544584 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:16.128417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 653/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Sep 21 09:56:15 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 09:56:18.259141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022da6-d7cf-45f2-94c3-63ce877b5ff1 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:18.259667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022da6-d7cf-45f2-94c3-63ce877b5ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:18.259667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022da6-d7cf-45f2-94c3-63ce877b5ff1 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:18.261015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 649/1302] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:56:18.266285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:18.266666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:18.266845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:18.285127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:56:18.286335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:56:18.351471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 654/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:56:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 09:56:18.624812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022da6-d7cf-45f2-94c3-63ce877b5ff1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:18.721728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:18.730371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022da6-d7cf-45f2-94c3-63ce877b5ff1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:18.763394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:18.764015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:18.764293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:18.764564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:18.765139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:18.766522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 09:56:18.775023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 09:56:18.776157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application with Lock( Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self._enter() Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application return self.creator() Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application created_value = creator( Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: ERROR keystone.server.flask.application Sep 21 09:56:18.777300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 650/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Sep 21 09:56:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 09:56:18.782066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:18.856382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:18.879881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fbc3-7953-4256-a23b-a17c61efb79b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:18.915573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:18.916175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:18.916452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:18.916721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] PATH_INFO: `/v3/services` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:18.917340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 09:56:18.917639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:18.919519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86851e1a-34cd-493c-bb0c-a4769fa961c3 None admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:18.924511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 655/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Sep 21 09:56:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 09:56:18.930450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:56:19.029448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72487d0e-da34-47fe-a7f1-9835c4a4b5e9 None admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:56:19.062116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:56:19.062743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:56:19.063019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:56:19.063293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:56:19.063958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:56:19.065299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1187f1-2c9d-426a-a508-606180695a1d None admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:56:19.083968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 651/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 09:56:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 09:56:28.921759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=30 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:56:29.080006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:27.695115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b900-4874-4e47-8766-8e3f410eff60 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:27.695725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b900-4874-4e47-8766-8e3f410eff60 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:27.695817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b900-4874-4e47-8766-8e3f410eff60 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:27.697695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 656/1307] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:27.704765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc457-80b5-4e8a-97b7-6cde6500a91b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:27.705322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc457-80b5-4e8a-97b7-6cde6500a91b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:27.705322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcc457-80b5-4e8a-97b7-6cde6500a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:27.881530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f5fcc457-80b5-4e8a-97b7-6cde6500a91b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:27.882792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f5fcc457-80b5-4e8a-97b7-6cde6500a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:28.138592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 652/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:28.495837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:28.496529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:28.497022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:28.499049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 657/1309] 10.222.0.20 () {54 vars in 963 bytes} [Wed Sep 21 09:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:57:28.520388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37600-c3c8-4654-9fde-bc23215696f9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:28.521059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37600-c3c8-4654-9fde-bc23215696f9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:28.521595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37600-c3c8-4654-9fde-bc23215696f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:28.727022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1ae37600-c3c8-4654-9fde-bc23215696f9 None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:28.729281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1ae37600-c3c8-4654-9fde-bc23215696f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:28.778350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:28.897232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 653/1310] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Sep 21 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:57:28.912744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:28.914667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:29.068263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04c68a-cea4-4178-8a0e-c96e4ddbbb3d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:29.159736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:29.160321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:29.160669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:29.160942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:29.163017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:29.227895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:29.297134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:29.298792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ddeb-2d44-4632-879e-db56818026eb service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:29.332513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 658/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:31.880267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:31.881092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:31.881092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:31.882144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 654/1312] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:31.889076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5c1f-83c5-4253-b916-98e449831d79 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:31.889598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5c1f-83c5-4253-b916-98e449831d79 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:31.889992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5c1f-83c5-4253-b916-98e449831d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:31.988779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a13c5c1f-83c5-4253-b916-98e449831d79 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:31.990487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a13c5c1f-83c5-4253-b916-98e449831d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:32.095959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 659/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:32.384187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:32.386457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:32.506639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a0cff-48d8-44bd-9523-11ba7f83ccd4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:32.587507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:32.590512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:32.591289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:32.591930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:32.592669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:32.594721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:32.751058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:32.752536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec19af6-7245-4eb3-bc12-4800b9b24f0a service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:32.773118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 655/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:35.488964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:35.489507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:35.489605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:35.491028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 660/1315] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:35.497380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501cb8-4c5d-416a-8d71-ada6ed957ec9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:35.497887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501cb8-4c5d-416a-8d71-ada6ed957ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:35.497996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501cb8-4c5d-416a-8d71-ada6ed957ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:35.571201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-26501cb8-4c5d-416a-8d71-ada6ed957ec9 None None] MFA Rules not processed for user `ca2e6a162d0049e2a445e7c785b3f0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:35.572451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-26501cb8-4c5d-416a-8d71-ada6ed957ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:35.634457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:35.715448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 656/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:36.011209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:36.012803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:36.024295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:36.143886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d6de-f780-4f08-a900-5d34e9b4a5f2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:36.226506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:36.227033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:36.227313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:36.227585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:36.229233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:36.295117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:36.344863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:36.347313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf39e5-11da-4480-bc61-f77068b79573 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:36.375295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 661/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:39.238568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:39.239134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:39.239134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:39.240464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 657/1318] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:39.246928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768df55-136c-4fd2-9ed8-d744fb898ebd None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:39.247639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768df55-136c-4fd2-9ed8-d744fb898ebd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:39.247823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768df55-136c-4fd2-9ed8-d744fb898ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:39.322194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8768df55-136c-4fd2-9ed8-d744fb898ebd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:39.323439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8768df55-136c-4fd2-9ed8-d744fb898ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:39.437976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 662/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:39.727858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:39.729458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:39.834891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ddcb9-ceb0-4c38-a969-4493e48ebcf8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:39.910773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:39.911384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:39.911656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:39.911925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:39.913509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:39.920572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:40.022741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:40.024184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504cb0a-aeeb-41cf-bfe6-d6fae7481e23 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:40.047777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 658/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:42.904910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:42.905591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:42.905591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:42.906987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 663/1321] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:57:42.912635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23cd5-f72b-4721-bcf6-ab6f0d69320b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:42.913108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23cd5-f72b-4721-bcf6-ab6f0d69320b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:42.913202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23cd5-f72b-4721-bcf6-ab6f0d69320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:42.995567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f4f23cd5-f72b-4721-bcf6-ab6f0d69320b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:42.996752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f4f23cd5-f72b-4721-bcf6-ab6f0d69320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:43.068553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:43.122063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 659/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:43.422869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:43.424492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:43.448341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:43.533981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d744-7fdf-4c39-847f-f6e2cd8bf8aa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:43.609010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:43.609610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:43.609885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:43.610154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:43.611767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:43.684988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:43.726613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:43.728107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0b24f-89a4-45c9-a505-899886b8f7a1 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:43.748674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 664/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:45.966228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:45.966776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:45.966878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:45.968310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 660/1324] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:45.973828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebefb2-c865-4136-b450-dcf9b5aeee54 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:45.974360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebefb2-c865-4136-b450-dcf9b5aeee54 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:45.974467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebefb2-c865-4136-b450-dcf9b5aeee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:46.045090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e1ebefb2-c865-4136-b450-dcf9b5aeee54 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:46.046368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1ebefb2-c865-4136-b450-dcf9b5aeee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:46.162190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 665/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:46.456034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:46.457958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:46.573392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77390462-487c-404e-a963-b6d34e76a5fb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:46.666154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:46.666851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:46.667138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:46.667413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:46.669209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:46.690690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:46.809548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:46.815858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fcfbe-84ca-4ffd-a2da-c832f90fe333 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:46.845890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 661/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:49.107085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:49.107654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:49.107654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:49.108921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 666/1327] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:49.115040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11b9a-8db7-42fb-8e83-3f212fb2be03 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:49.115584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11b9a-8db7-42fb-8e83-3f212fb2be03 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:49.115584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11b9a-8db7-42fb-8e83-3f212fb2be03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:49.193726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-66c11b9a-8db7-42fb-8e83-3f212fb2be03 None None] MFA Rules not processed for user `ca2e6a162d0049e2a445e7c785b3f0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:49.194968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66c11b9a-8db7-42fb-8e83-3f212fb2be03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:49.267061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:49.299076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 662/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:49.589912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:49.591509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:49.627436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:49.726673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f8455-3d21-4dbf-a3a0-bac06d3bf9ec None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:49.808471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:49.809100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:49.809370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:49.809642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:49.811299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:49.897562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:49.934947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:49.936432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42fe25-0102-4cdd-8a79-9d4683d7ea7e service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:49.958590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 667/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:52.487332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:52.487904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:52.487904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:52.489229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 663/1330] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:52.494575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6481-d048-4b79-b9b5-b8cb85259524 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:52.495050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6481-d048-4b79-b9b5-b8cb85259524 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:52.495157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6481-d048-4b79-b9b5-b8cb85259524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:52.565081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bebf6481-d048-4b79-b9b5-b8cb85259524 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:52.566322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bebf6481-d048-4b79-b9b5-b8cb85259524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:52.667158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 668/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:52.947568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:52.949125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:53.065939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cf9e-a510-4db9-9a05-9d7c560a778b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:53.143787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:53.144393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:53.144669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:53.144944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:53.146604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:53.177212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:53.263405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:53.266038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f52f69-2a51-4370-9dea-633d1f38c990 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:53.289700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 664/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 09:57:55.580989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:55.581538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:55.581656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:55.583975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 669/1333] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:55.588862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43508d-d65c-4e40-86bf-8d0ebce547c3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:55.589410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43508d-d65c-4e40-86bf-8d0ebce547c3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:55.589410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43508d-d65c-4e40-86bf-8d0ebce547c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:55.661975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bc43508d-d65c-4e40-86bf-8d0ebce547c3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:55.663254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bc43508d-d65c-4e40-86bf-8d0ebce547c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:55.745953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:55.771143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 665/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:57:56.062761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:56.064293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:56.106142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:56.177385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733cf0-cbd6-459e-a748-37577f507af4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:56.266463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:56.266986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:56.267269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:56.267538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:56.269269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:56.365366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:56.394612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:56.396074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9619b5e-2389-4983-b0c0-de822a69d7f2 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:56.417330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 670/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:57:58.924522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:58.925370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:58.925550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:58.927098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 666/1336] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:57:58.932887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27c1-6289-461b-bf58-ddc711df5498 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:58.933376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27c1-6289-461b-bf58-ddc711df5498 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:58.933486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27c1-6289-461b-bf58-ddc711df5498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:58.999318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e7bd27c1-6289-461b-bf58-ddc711df5498 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:57:59.000533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7bd27c1-6289-461b-bf58-ddc711df5498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:59.098653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 671/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:57:59.385115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:57:59.386696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:59.488835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075efdb6-2113-4bf2-b91e-874f98e470b5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:57:59.570866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:57:59.571476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:57:59.571757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:57:59.572066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:57:59.573944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:57:59.613265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:57:59.700154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:57:59.701566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7b7d-f45f-467d-ac8b-faf04768be5a service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:57:59.723446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 667/1338] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:57:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:03.856103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:03.856646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:03.856646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:03.858133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 672/1339] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:03.863743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9280a9-1804-4545-ad97-cd9fbcd4c977 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:03.864247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9280a9-1804-4545-ad97-cd9fbcd4c977 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:03.864351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9280a9-1804-4545-ad97-cd9fbcd4c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:03.942289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7e9280a9-1804-4545-ad97-cd9fbcd4c977 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:03.943525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e9280a9-1804-4545-ad97-cd9fbcd4c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:04.043948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:04.056523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 668/1340] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:04.338960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:04.341748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:04.393273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:04.449590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d642c-8a62-4cdd-bb36-a241f766a082 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:04.523309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:04.523915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:04.524190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:04.524458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:04.526704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:04.622416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:04.639712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:04.641162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d5644-02cb-4ea2-a2cb-5acc2a54039d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:04.663300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 673/1341] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:07.565776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:07.566428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:07.566428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:07.567710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 669/1342] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:07.574031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c033-1934-4435-9b05-15b81ba3039c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:07.574618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c033-1934-4435-9b05-15b81ba3039c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:07.574618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c033-1934-4435-9b05-15b81ba3039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:07.654045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3b20c033-1934-4435-9b05-15b81ba3039c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:07.655351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3b20c033-1934-4435-9b05-15b81ba3039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:07.763286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 674/1343] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:08.050132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:08.051750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:08.180271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520eaab-0064-496f-9f22-0a230c3e8bbe None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:08.281149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:08.281814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:08.282201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:08.282552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:08.284433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:08.340020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:08.425099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:08.426640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8f743-e11c-4cd6-9e74-df135f722175 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:08.448569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 670/1344] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:12.862603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:12.863143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:12.863143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:12.864532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 675/1345] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:12.870432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd1bd-63f4-4784-8b96-c0dea4e556ea None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:12.871134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd1bd-63f4-4784-8b96-c0dea4e556ea None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:12.871134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd1bd-63f4-4784-8b96-c0dea4e556ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:12.945719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-87dfd1bd-63f4-4784-8b96-c0dea4e556ea None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:12.947550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-87dfd1bd-63f4-4784-8b96-c0dea4e556ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:13.051698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:13.058288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 671/1346] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:13.340206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:13.341733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:13.401050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:13.450134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2485b-d6fb-4ab9-afb6-dac4a6dfb058 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:13.526000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:13.526640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:13.526920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:13.527191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:13.528826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:13.639810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:13.643851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:13.646357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fa8e0-8620-4dfa-ac9c-2d9a0755ac4a service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:13.668514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 676/1347] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:18.815181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e73fa-4dc9-42b0-a70d-e155c711f7a4 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:18.815629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e73fa-4dc9-42b0-a70d-e155c711f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:18.815629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e73fa-4dc9-42b0-a70d-e155c711f7a4 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:18.816891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 672/1348] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 09:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:18.825458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04556-9362-42d6-b43e-8be4e04f164b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:18.825458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04556-9362-42d6-b43e-8be4e04f164b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:18.825458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04556-9362-42d6-b43e-8be4e04f164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:18.948322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-68c04556-9362-42d6-b43e-8be4e04f164b None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:18.949980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-68c04556-9362-42d6-b43e-8be4e04f164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:19.103123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 677/1349] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:23.614301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac9f2-5cae-437d-8f9b-0aaddea8cff0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:23.615103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac9f2-5cae-437d-8f9b-0aaddea8cff0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:23.615524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac9f2-5cae-437d-8f9b-0aaddea8cff0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:23.617121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 673/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 09:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:23.624111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8ea-a052-4218-a798-f06af1636704 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:23.624904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8ea-a052-4218-a798-f06af1636704 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:23.624904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8ea-a052-4218-a798-f06af1636704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:23.687529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:23.720940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f8ecc8ea-a052-4218-a798-f06af1636704 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:23.722736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8ecc8ea-a052-4218-a798-f06af1636704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:23.870597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 678/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:25.379696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c40b6-7858-4ff6-9b73-15613a98e6c3 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:25.380272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c40b6-7858-4ff6-9b73-15613a98e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:25.380577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c40b6-7858-4ff6-9b73-15613a98e6c3 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:25.383664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 674/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 09:58:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:25.392046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135217b9-115a-43f5-952e-85d14cebae49 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:25.392891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135217b9-115a-43f5-952e-85d14cebae49 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:25.393054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135217b9-115a-43f5-952e-85d14cebae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:25.511156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-135217b9-115a-43f5-952e-85d14cebae49 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:25.512677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-135217b9-115a-43f5-952e-85d14cebae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:25.571398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:25.655782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 679/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:29.998360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090936b-11c3-4633-95c7-f6badabffced None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:29.998955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090936b-11c3-4633-95c7-f6badabffced None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:29.998955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090936b-11c3-4633-95c7-f6badabffced None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:30.000259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 675/1354] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:30.006194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aecc-72d4-42f5-93b3-db10b0c068ba None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:30.006972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aecc-72d4-42f5-93b3-db10b0c068ba None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:30.007164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aecc-72d4-42f5-93b3-db10b0c068ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:30.081363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ffe4aecc-72d4-42f5-93b3-db10b0c068ba None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:30.082638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ffe4aecc-72d4-42f5-93b3-db10b0c068ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:30.245613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 680/1355] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:30.609166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:30.609831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:30.610265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:30.612709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 676/1356] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 21 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:30.621945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b21047-fee3-4655-ad3e-db717cd8a300 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:30.622424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b21047-fee3-4655-ad3e-db717cd8a300 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:30.622877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b21047-fee3-4655-ad3e-db717cd8a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:30.649369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:30.744641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a3b21047-fee3-4655-ad3e-db717cd8a300 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:30.745880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3b21047-fee3-4655-ad3e-db717cd8a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:30.899542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 681/1357] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:30.908484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:30.911161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:31.109554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496b5b7-897b-4910-908d-ad2c73d35fed None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:31.258421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:31.339107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:31.340311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:31.340923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:31.341504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:31.345022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:31.521887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:31.526118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1bf44-ecf3-4206-984a-6c88c5688f09 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:31.565674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 677/1358] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:34.276643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:34.277096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:34.277096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:34.278720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 682/1359] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:34.284356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c2b0-630a-4f2d-bb96-1034b90eaf12 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:34.284855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c2b0-630a-4f2d-bb96-1034b90eaf12 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:34.285386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c2b0-630a-4f2d-bb96-1034b90eaf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:34.365738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5ed3c2b0-630a-4f2d-bb96-1034b90eaf12 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:34.368370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5ed3c2b0-630a-4f2d-bb96-1034b90eaf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:34.408978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:34.477494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 678/1360] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:34.769338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:34.770928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:34.860848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:34.985056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97474331-658b-4f23-9058-e0e937d941e8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:35.133097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:35.133710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:35.133983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:35.134268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:35.135904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:35.161849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:35.245897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:35.247741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd0c8-9b20-48ff-85ae-c4ad330450df service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:35.271795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 683/1361] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:37.897965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e05b6-943b-4857-904d-94ad322bd249 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:37.898856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e05b6-943b-4857-904d-94ad322bd249 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:37.898856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e05b6-943b-4857-904d-94ad322bd249 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:37.900569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 679/1362] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:58:37.906036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a5a-9d4f-4ad9-ae3b-c7cea807c5c7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:37.906790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a5a-9d4f-4ad9-ae3b-c7cea807c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:37.906790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a5a-9d4f-4ad9-ae3b-c7cea807c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:37.987481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-10134a5a-9d4f-4ad9-ae3b-c7cea807c5c7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:37.988083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-10134a5a-9d4f-4ad9-ae3b-c7cea807c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:38.105650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:38.108170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 684/1363] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:38.495266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:38.495627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:38.495835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:38.497424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 680/1364] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 21 09:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:58:38.502806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2918-e15f-45a7-8cb7-56ed19436245 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:38.503096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2918-e15f-45a7-8cb7-56ed19436245 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:38.503373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a2918-e15f-45a7-8cb7-56ed19436245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:38.593242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6d4a2918-e15f-45a7-8cb7-56ed19436245 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:38.594430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6d4a2918-e15f-45a7-8cb7-56ed19436245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:38.765427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 685/1365] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 21 09:58:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:38.778896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:38.783252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:38.999350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a6b3-25f6-49a4-a1d8-165dedc30ec6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:39.028930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:39.169163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:39.170144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:39.170711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:39.171216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:39.173309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:39.298332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:39.300355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426b486-27b2-4632-96ce-9b3410df9b00 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:39.324894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 681/1366] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 09:58:39.575173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289ea-91d1-492d-93d4-b1513874f922 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:39.575715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289ea-91d1-492d-93d4-b1513874f922 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:39.575715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289ea-91d1-492d-93d4-b1513874f922 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:39.577209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 686/1367] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:39.583407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca342-2e04-4b22-b841-1c4d31935f99 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:39.583694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca342-2e04-4b22-b841-1c4d31935f99 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:39.583959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ca342-2e04-4b22-b841-1c4d31935f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:39.627576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:39.676610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1a7ca342-2e04-4b22-b841-1c4d31935f99 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:39.677864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1a7ca342-2e04-4b22-b841-1c4d31935f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:39.839764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 682/1368] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:40.144466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:40.145300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:40.146167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:40.150043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 687/1369] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 21 09:58:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:40.156193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda68-439b-46a2-b230-afe8f82ee516 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:40.157269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda68-439b-46a2-b230-afe8f82ee516 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:40.157454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda68-439b-46a2-b230-afe8f82ee516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:40.270681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d9eda68-439b-46a2-b230-afe8f82ee516 None None] MFA Rules not processed for user `97c7227deb9048398d33ff330b8df8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:40.272897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d9eda68-439b-46a2-b230-afe8f82ee516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:40.384056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:40.451366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 683/1370] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 21 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:40.463691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:40.467438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:40.572884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:40.639080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8736-b1b4-4c76-9626-6bb576f720c2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:40.725016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:40.726166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:40.726540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:40.726857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:40.728556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:40.863496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:40.882023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:40.883568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63793704-aa34-43c7-aeb0-9bded86dc04b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:40.906756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 688/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:41.926392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:41.926971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:41.927134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:41.928562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 684/1372] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:41.934394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a67-d37d-4ada-aa51-93f3eefb81b5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:41.934897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a67-d37d-4ada-aa51-93f3eefb81b5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:41.935090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a67-d37d-4ada-aa51-93f3eefb81b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:42.023476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-68e52a67-d37d-4ada-aa51-93f3eefb81b5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:42.024793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-68e52a67-d37d-4ada-aa51-93f3eefb81b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:42.181543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 689/1373] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:42.485654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:42.487893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:42.695005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792e52-e07d-4cd3-a8e3-120d5d9d195b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:42.764487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:42.846914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:42.847940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:42.848440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:42.848994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:42.852459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:42.978202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:42.979887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6d2b6-9777-4be8-b3db-cf535a167a2b service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:43.002608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 685/1374] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:45.642540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:45.643467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:45.643801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:45.645351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 690/1375] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:45.652049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35608-8b1f-4393-8af0-43484e7eabb8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:45.652945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35608-8b1f-4393-8af0-43484e7eabb8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:45.652945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35608-8b1f-4393-8af0-43484e7eabb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:45.760030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-57f35608-8b1f-4393-8af0-43484e7eabb8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:45.761254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-57f35608-8b1f-4393-8af0-43484e7eabb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:45.769903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:45.891577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 686/1376] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:46.325962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:46.328099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:46.422029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:46.576406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61571f-a0d6-45db-b365-d4a4195b6e15 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:46.759580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:46.760424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:46.760521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:46.760709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:46.762456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:46.786156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:46.880404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:46.882443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d33d65-7c4c-468f-9ee1-fb131855905e service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:46.906896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 691/1377] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:49.902617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:49.903437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:49.903593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:49.906421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 687/1378] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:49.916102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7fcf-00ad-4648-8c4b-35f6c0dafcb4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:49.917216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7fcf-00ad-4648-8c4b-35f6c0dafcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:49.917216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7fcf-00ad-4648-8c4b-35f6c0dafcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:50.007636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-413b7fcf-00ad-4648-8c4b-35f6c0dafcb4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:50.008965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-413b7fcf-00ad-4648-8c4b-35f6c0dafcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:50.139860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:50.151252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 692/1379] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:50.452819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:50.457350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:50.681783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:50.695158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64c07-b0be-4e7b-816e-f27f9512da18 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:50.869539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:50.870477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:50.870843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:50.871272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:50.875277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:50.983905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:50.985447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7881a3-0623-4e0e-a4a5-c64247b0be61 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:50.997773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:51.014655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 688/1380] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:53.288688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:53.289239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:53.289239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:53.290587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 693/1381] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:53.296628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf1e27-c821-4ab2-834f-6b11690f5e87 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:53.297428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf1e27-c821-4ab2-834f-6b11690f5e87 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:53.297542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf1e27-c821-4ab2-834f-6b11690f5e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:53.389479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-68cf1e27-c821-4ab2-834f-6b11690f5e87 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:53.390743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-68cf1e27-c821-4ab2-834f-6b11690f5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:53.528826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 689/1382] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:53.828460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:53.830298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:54.069736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e5ad-6c4f-449e-931a-3bbf252473c3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:54.175276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:54.256190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:54.256768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:54.257073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:54.257348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:54.259061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:54.387837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:54.390342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f664e-827d-4d36-8606-4458830ec811 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:54.423133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 694/1383] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:58:56.850490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bc46-314b-426b-a446-d6118fbe7525 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:56.851007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bc46-314b-426b-a446-d6118fbe7525 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:56.851007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bc46-314b-426b-a446-d6118fbe7525 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:56.852285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 690/1384] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:56.858479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a842-f656-49f7-97e1-84d2eaaccf58 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:56.859036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a842-f656-49f7-97e1-84d2eaaccf58 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:56.859263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a842-f656-49f7-97e1-84d2eaaccf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:56.925858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378f8d-5e1f-4b85-8137-faf85fa49894 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:56.926139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378f8d-5e1f-4b85-8137-faf85fa49894 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:56.926448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378f8d-5e1f-4b85-8137-faf85fa49894 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:56.927845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 691/1385] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:58:56.933321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838a5a-005f-4637-802e-d8b8268f8a00 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:56.933502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0829a842-f656-49f7-97e1-84d2eaaccf58 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:56.933616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838a5a-005f-4637-802e-d8b8268f8a00 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:56.933869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838a5a-005f-4637-802e-d8b8268f8a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:56.934752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0829a842-f656-49f7-97e1-84d2eaaccf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:56.979092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:57.018067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f5838a5a-005f-4637-802e-d8b8268f8a00 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:57.019402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f5838a5a-005f-4637-802e-d8b8268f8a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:57.048387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:57.056400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 695/1386] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:57.138712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 692/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:58:57.371611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:57.371911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:57.372201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:57.373601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 696/1388] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 21 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:57.379560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:57.379847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:57.380128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:57.467959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] MFA Rules not processed for user `4480ebef3a0f4a2cb5a2508ff9e0ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:57.469452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:57.472097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:57.473710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:57.562600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 693/1389] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:57.572505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:57.580687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3fba-bad3-4569-8ca8-2a9cb04dcce1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:57.600166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:57.654790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18836b-14fd-4bf4-a83c-9eabf22516e1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:57.666151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:57.666812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:57.667094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:57.667369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:57.669091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:57.675022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:57.794078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:57.794719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:57.794997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:57.795268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:57.796897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:57.798870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:57.801573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d630f-4620-4ff0-b410-07fbd3ccd749 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:57.827450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 694/1390] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 09:58:57.905171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:57.907218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fcf7b-b034-490e-b3dc-a3968fd44cc8 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:57.929386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 697/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 09:58:58.639292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85cd-a0a7-4320-9c1f-1190a17acbe4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:58.639983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85cd-a0a7-4320-9c1f-1190a17acbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:58.639983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85cd-a0a7-4320-9c1f-1190a17acbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:58.704613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:58.715027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d59c85cd-a0a7-4320-9c1f-1190a17acbe4 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:58.716303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d59c85cd-a0a7-4320-9c1f-1190a17acbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:58.812132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 695/1392] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:58.865700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:58.866082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:58.866482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:58.867906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 698/1393] 10.222.0.20 () {54 vars in 943 bytes} [Wed Sep 21 09:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:58:58.875409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aac91-8be2-48b8-969b-ab9b81298ca1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:58.875923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aac91-8be2-48b8-969b-ab9b81298ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:58.876365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aac91-8be2-48b8-969b-ab9b81298ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:58.965565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-079aac91-8be2-48b8-969b-ab9b81298ca1 None None] MFA Rules not processed for user `894ed64582f5481f8e5c5c70bb901e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:58:58.966863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-079aac91-8be2-48b8-969b-ab9b81298ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:59.040990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:59.078289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 696/1394] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Sep 21 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:58:59.088441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:58:59.090013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:59.114676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:59.266623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c49b-bf6b-49d7-a3e5-83b2d20bb56f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:58:59.391882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:58:59.392506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:58:59.392801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:58:59.393062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:58:59.394775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:58:59.404377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:58:59.490732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:58:59.492376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd24d5-cb8b-4db8-8ed1-3ba72e67bb4d service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:58:59.500579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 699/1395] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 09:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 09:59:00.305153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:00.305951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:00.305951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:00.310803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 697/1396] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:59:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:59:00.314746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197008f-74eb-45bc-9b00-7696006688c5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:00.315289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197008f-74eb-45bc-9b00-7696006688c5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:00.315459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197008f-74eb-45bc-9b00-7696006688c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:00.445689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3197008f-74eb-45bc-9b00-7696006688c5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:00.447390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3197008f-74eb-45bc-9b00-7696006688c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:00.574378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:00.586446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 700/1397] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:00.869443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:00.871031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:01.068534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116ae6-f483-4f79-8d31-875e7d3a8f82 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:01.226455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:01.316196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:01.317272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:01.317443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:01.317817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:01.319614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:01.431929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:01.433855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1449-f64f-40ba-a627-c09af54a571e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:01.457614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 698/1398] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:03.749994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:03.750609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:03.750609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:03.751944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 701/1399] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:59:03.757777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d68a-09aa-4740-adaa-c9438a95b69a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:03.758319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d68a-09aa-4740-adaa-c9438a95b69a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:03.758421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d68a-09aa-4740-adaa-c9438a95b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:03.835037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2ba7d68a-09aa-4740-adaa-c9438a95b69a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:03.836498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2ba7d68a-09aa-4740-adaa-c9438a95b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:03.839731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:03.962525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 699/1400] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:04.260633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:04.263009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:04.489959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c009-9251-4121-bde1-2c56a6d76fc5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:04.590832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:04.650129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:04.650983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:04.651313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:04.651677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:04.653457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:04.787427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:04.790518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aa3b0-82f0-41d4-a355-c2ccc9489670 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:04.825382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 702/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 09:59:07.256371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:07.256371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:07.257087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:07.258614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 700/1402] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:07.265102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2ca8-1c04-4169-85fb-d19f761f7c06 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:07.265654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2ca8-1c04-4169-85fb-d19f761f7c06 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:07.265654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2ca8-1c04-4169-85fb-d19f761f7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:07.370018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6aeb2ca8-1c04-4169-85fb-d19f761f7c06 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:07.372124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6aeb2ca8-1c04-4169-85fb-d19f761f7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:07.423947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:07.538383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 703/1403] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:07.886629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:07.889433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:08.104113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:08.121133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a268-a55b-4e7c-b6e2-cd5075c9d124 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:08.306071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:08.307204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:08.307204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:08.307204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:08.308944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:08.452005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:08.454093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246dbb8-0ea3-4c5c-b6e0-7616b14e0f1e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:08.471619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:08.485100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 701/1404] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:10.895826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:10.896371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:10.896371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:10.898030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 704/1405] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 09:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:10.904711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2f50-1427-4f77-80a8-3aa1d0fad7a5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:10.906381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2f50-1427-4f77-80a8-3aa1d0fad7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:10.907154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2f50-1427-4f77-80a8-3aa1d0fad7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:10.999058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-769a2f50-1427-4f77-80a8-3aa1d0fad7a5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:11.000669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-769a2f50-1427-4f77-80a8-3aa1d0fad7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:11.157131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 702/1406] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:11.528919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:11.532557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:11.765917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d12d6-2100-43f8-b673-34f86aed7dcf None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:11.787236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:11.905212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:11.906648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:11.907082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:11.907525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:11.909610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:12.038211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:12.041228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff466ad-175c-4584-a414-2773131abf2a service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:12.079316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 705/1407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:21.141940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=68 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:22.073773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:23.191947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bf42-3112-4dec-a0fb-847d912d0b02 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:23.192529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bf42-3112-4dec-a0fb-847d912d0b02 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:23.192529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34bf42-3112-4dec-a0fb-847d912d0b02 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:23.193934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 703/1408] 10.222.0.20 () {54 vars in 918 bytes} [Wed Sep 21 09:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:23.200105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8066-8924-49b2-ab3a-63dcabd658d4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:23.200617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8066-8924-49b2-ab3a-63dcabd658d4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:23.200732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8066-8924-49b2-ab3a-63dcabd658d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:23.282109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e1ad8066-8924-49b2-ab3a-63dcabd658d4 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:23.283385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1ad8066-8924-49b2-ab3a-63dcabd658d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:23.394431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 706/1409] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:23.411411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb286a2-47b2-4f0d-a1ce-1a4e6fa53ada None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:23.411695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb286a2-47b2-4f0d-a1ce-1a4e6fa53ada None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:23.411980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb286a2-47b2-4f0d-a1ce-1a4e6fa53ada None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:23.413373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 704/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Sep 21 09:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:59:23.420094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c8e9-614d-4e98-aa25-7b2425343ab4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:23.420382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c8e9-614d-4e98-aa25-7b2425343ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:23.420660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c8e9-614d-4e98-aa25-7b2425343ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:23.504281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:23.509666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5799c8e9-614d-4e98-aa25-7b2425343ab4 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:23.511718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5799c8e9-614d-4e98-aa25-7b2425343ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:23.638993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 707/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:59:26.249781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:26.250341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:26.250341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:26.251693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 705/1412] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:26.257351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775023-1741-4683-a54e-9658fa00c1fa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:26.257841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775023-1741-4683-a54e-9658fa00c1fa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:26.257938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775023-1741-4683-a54e-9658fa00c1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:26.334840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ef775023-1741-4683-a54e-9658fa00c1fa None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:26.336007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ef775023-1741-4683-a54e-9658fa00c1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:26.394837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:26.439239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 708/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:26.738282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:26.739822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:26.919079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd850-1b9e-437d-8933-e1587bc19ede None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:26.994863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:27.036590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:27.037208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:27.037503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:27.037775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:27.039443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:27.132559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:27.134162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a22b1-abba-44c9-97ec-ffa3a4a77407 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:27.157827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 706/1414] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:28.340315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:28.340829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:28.340829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:28.342459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 709/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 09:59:28.350309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433a22-5a38-4b32-9a05-f3c0c86c9501 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:28.350843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433a22-5a38-4b32-9a05-f3c0c86c9501 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:28.350946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433a22-5a38-4b32-9a05-f3c0c86c9501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:28.426672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-34433a22-5a38-4b32-9a05-f3c0c86c9501 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:28.427891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-34433a22-5a38-4b32-9a05-f3c0c86c9501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:28.455978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:28.539597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 707/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:28.692390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:28.693943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:28.849040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a33b-b641-478c-8e39-df85b479be62 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:28.889846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:28.963299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:28.963825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:28.964107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:28.964379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:28.966000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:29.063130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:29.064754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050492-84c9-4d3d-a824-d3a96a12028b service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:29.083456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 710/1417] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:30.242356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:30.242963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:30.242963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:30.244290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 708/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:30.251347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e948-2c66-416b-b14d-9c19d9360d76 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:30.251812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e948-2c66-416b-b14d-9c19d9360d76 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:30.251938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e948-2c66-416b-b14d-9c19d9360d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:30.313197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:30.337275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4111e948-2c66-416b-b14d-9c19d9360d76 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:30.338593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4111e948-2c66-416b-b14d-9c19d9360d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:30.439843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 711/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:30.600341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:30.601921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:30.763229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edb990-a17c-4ce5-b570-9a465e711795 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:30.775428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:30.883276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:30.883897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:30.884179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:30.884460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:30.886102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:30.977160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:30.978811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811794-6347-4093-a9b2-4373784296ff service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:30.997465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 709/1420] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:32.149099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:32.149767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:32.149767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:32.151077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 712/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:32.158065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264570-fe6d-46e6-b510-dcb3993ae09f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:32.158666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264570-fe6d-46e6-b510-dcb3993ae09f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:32.158666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264570-fe6d-46e6-b510-dcb3993ae09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:32.186558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:32.245007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-81264570-fe6d-46e6-b510-dcb3993ae09f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:32.246262 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-81264570-fe6d-46e6-b510-dcb3993ae09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:32.348916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 710/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:32.500095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:32.501635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:32.616651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:32.653635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158cc5-2134-428c-9e3a-81dfc95b417a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:32.765662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:32.766297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:32.766583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:32.766859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:32.768460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:32.851752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:32.865356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:32.867031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f99e8-c2cb-4c4f-bfc9-3383ee5274a3 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:32.885118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 713/1423] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:34.025399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:34.025808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:34.026010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:34.027300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 711/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:34.036569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e35b92-f31e-4add-b250-853a3571ddcc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:34.037091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e35b92-f31e-4add-b250-853a3571ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:34.037198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e35b92-f31e-4add-b250-853a3571ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:34.113512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-10e35b92-f31e-4add-b250-853a3571ddcc None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:34.114755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-10e35b92-f31e-4add-b250-853a3571ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:34.215395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 714/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:34.368270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:34.369719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:34.458580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:34.522829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6594ff-bc20-4a8b-a328-bab549289b54 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:34.643693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:34.644879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:34.645332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:34.645618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:34.647344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:34.712069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:34.756419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:34.758046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db22fc1-9fad-4852-9fb6-fe48a356f290 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:34.776215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 712/1426] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:35.871563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:35.872124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:35.872124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:35.873525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:35.880063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608efa-9b01-4b72-8ce6-ac5c4fc944b5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:35.880709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608efa-9b01-4b72-8ce6-ac5c4fc944b5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:35.880709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72608efa-9b01-4b72-8ce6-ac5c4fc944b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:35.957529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-72608efa-9b01-4b72-8ce6-ac5c4fc944b5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:35.958678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-72608efa-9b01-4b72-8ce6-ac5c4fc944b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:36.057099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:36.211023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:36.212460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:36.261931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:36.365528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeafab2-3b9b-4f2d-ad06-e2293a495a3e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:36.492507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:36.493028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:36.493307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:36.493579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:36.495240 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:36.502455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:36.596744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:36.597533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89c8c-c7b1-4fe3-b9f9-ee59ad65c402 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:36.615846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 716/1429] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:37.683984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:37.684668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:37.684668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:37.685875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:37.692957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881010f-ee44-4812-b305-f212789e75ec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:37.693456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881010f-ee44-4812-b305-f212789e75ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:37.693564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881010f-ee44-4812-b305-f212789e75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:37.775145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c881010f-ee44-4812-b305-f212789e75ec None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:37.776358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c881010f-ee44-4812-b305-f212789e75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:37.844426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:37.876218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:38.025358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:38.028345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:38.047680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:38.183248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544702b3-1b61-4b38-b3fe-1ebe67474a19 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:38.287453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:38.314220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:38.314869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:38.315168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:38.315440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:38.317102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:38.412561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:38.414181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34cfdc-f490-4ec5-970f-abadea43d6bf service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:38.433042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 715/1432] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:39.502353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:39.502903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:39.502903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:39.504793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:39.511521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416e63-481c-4f9e-8cd5-6bfa630dfe72 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:39.512029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416e63-481c-4f9e-8cd5-6bfa630dfe72 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:39.512128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416e63-481c-4f9e-8cd5-6bfa630dfe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:39.587746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d5416e63-481c-4f9e-8cd5-6bfa630dfe72 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:39.588953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5416e63-481c-4f9e-8cd5-6bfa630dfe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:39.635964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:39.810427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:39.969558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:39.971084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:40.118704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab08593-d3f5-4631-bcd1-8d24ebd20988 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:40.175403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:40.238052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:40.238719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:40.238999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:40.239265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:40.240885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:40.350901 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:40.352617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e113-03e1-42cd-8d46-c6da16408bdb service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:40.371775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 719/1435] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:41.437786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:41.438382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:41.438382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:41.439703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 09:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:41.446177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076ff-dd96-4835-847b-acc2e1c6afd9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:41.446667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076ff-dd96-4835-847b-acc2e1c6afd9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:41.446774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076ff-dd96-4835-847b-acc2e1c6afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:41.529023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ae6076ff-dd96-4835-847b-acc2e1c6afd9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:41.530267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ae6076ff-dd96-4835-847b-acc2e1c6afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:41.532305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:41.635048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 09:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:41.786319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:41.787826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:41.930837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c0a5-c686-4efa-a754-e293dc9b47bd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:41.962648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:42.056902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:42.057511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:42.057788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:42.058056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:42.059690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:42.152355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:42.153949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d9a0-a6fe-4eea-b985-ed017cfc103e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:42.172855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 718/1438] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:44.288534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf2b2-07ee-40d8-adea-1ebda9c7f46e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:44.289067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf2b2-07ee-40d8-adea-1ebda9c7f46e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:44.289067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf2b2-07ee-40d8-adea-1ebda9c7f46e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:44.290552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:44.295714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824453cf-4c30-497b-880d-2c4a7c38c92c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:44.296157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824453cf-4c30-497b-880d-2c4a7c38c92c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:44.296250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824453cf-4c30-497b-880d-2c4a7c38c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:44.337818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:44.364845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-824453cf-4c30-497b-880d-2c4a7c38c92c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:44.366067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-824453cf-4c30-497b-880d-2c4a7c38c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:44.464315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:44.767913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:44.768245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:44.768538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:44.769910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 722/1441] 10.222.0.20 () {54 vars in 963 bytes} [Wed Sep 21 09:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:44.775791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25624d-def0-4fed-aeab-c59623bcbe5f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:44.776079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25624d-def0-4fed-aeab-c59623bcbe5f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:44.776351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25624d-def0-4fed-aeab-c59623bcbe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:44.854009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8a25624d-def0-4fed-aeab-c59623bcbe5f None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:44.855230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8a25624d-def0-4fed-aeab-c59623bcbe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:44.905801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:44.931463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 720/1442] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Sep 21 09:59:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:44.940617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:44.942188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:45.047177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf99f0d-77a3-48be-ba24-59d0c8b4c4d6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:45.079818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:45.122388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:45.122991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:45.123264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:45.123531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:45.125137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:45.239163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:45.240628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3ba6f-3943-4306-9aba-308a49ca7f1f service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:45.260347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 723/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:48.070615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:48.071117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:48.071230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:48.072550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:48.078092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2e9a-3004-4042-b5d5-3ec79f1f2fcf None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:48.078569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2e9a-3004-4042-b5d5-3ec79f1f2fcf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:48.078668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e2e9a-3004-4042-b5d5-3ec79f1f2fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:48.148777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cd7e2e9a-3004-4042-b5d5-3ec79f1f2fcf None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:48.149977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cd7e2e9a-3004-4042-b5d5-3ec79f1f2fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:48.163573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:48.247264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:48.538330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:48.539942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:48.650030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3a1f-790f-43c7-8af5-0f20d7b4f061 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:48.728311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:48.728954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:48.729280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:48.729589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:48.731878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:48.766309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:48.847531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:48.848926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfc724-2002-4e25-bfc5-60295b581e0d service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:48.867101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 722/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:51.473794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:51.474353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:51.474353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:51.475621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:51.481195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b5f5-3cf8-418b-ad62-a275344b1d24 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:51.481631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b5f5-3cf8-418b-ad62-a275344b1d24 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:51.481726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b5f5-3cf8-418b-ad62-a275344b1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:51.546687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8ab4b5f5-3cf8-418b-ad62-a275344b1d24 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:51.547893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8ab4b5f5-3cf8-418b-ad62-a275344b1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:51.634078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:51.654128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:51.939272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:51.941312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:52.046587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ffa6-2aa2-4ce4-8c80-b470ab70b8e8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:52.087128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:52.122933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:52.123663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:52.123946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:52.124213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:52.125825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:52.236078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:52.238038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb93c5-4c38-4cb8-80f3-4ed70b8e8215 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:52.256564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 726/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:54.624533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:54.625076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:54.625205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:54.626798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:54.632850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7091-7dad-4f94-a240-2b3ee04af4ed None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:54.633300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7091-7dad-4f94-a240-2b3ee04af4ed None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:54.633396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7091-7dad-4f94-a240-2b3ee04af4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:54.704939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0eca7091-7dad-4f94-a240-2b3ee04af4ed None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:54.706789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0eca7091-7dad-4f94-a240-2b3ee04af4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:54.728007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:54.804673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 09:59:55.088947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:55.090532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:55.209449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56467e14-345f-4989-97fd-e2f81ce10bb7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:55.289264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:55.289885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:55.290188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:55.290491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:55.292109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:55.332219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:55.410034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:55.411515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e45675-d3ad-425c-a63d-05cbf2aade2e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:55.439022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 725/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 09:59:57.748119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:57.748685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:57.748685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:57.750083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 09:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 09:59:57.756156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7cbc-16b5-4a99-86d0-44b5f582d581 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:57.756608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7cbc-16b5-4a99-86d0-44b5f582d581 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:57.756743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7cbc-16b5-4a99-86d0-44b5f582d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:57.822465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-707e7cbc-16b5-4a99-86d0-44b5f582d581 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 09:59:57.823675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-707e7cbc-16b5-4a99-86d0-44b5f582d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:57.914222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:57.920647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 09:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 09:59:58.216051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 09:59:58.217851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:58.327100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdbdf6-faa8-44c4-89e4-acf316eee995 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 09:59:58.385484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 09:59:58.411363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 09:59:58.411967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 09:59:58.412244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 09:59:58.412511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 09:59:58.414109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 09:59:58.526308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 09:59:58.527759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265445d3-1855-4990-a5c1-608587d202a7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 09:59:58.546888 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 729/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 09:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:00.776135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:00.776665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:00.776665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:00.778041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:00.783587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8ce8-2f1f-43d2-9924-35884eec5c97 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:00.784066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8ce8-2f1f-43d2-9924-35884eec5c97 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:00.784175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea8ce8-2f1f-43d2-9924-35884eec5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:00.850808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e3ea8ce8-2f1f-43d2-9924-35884eec5c97 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:00.852005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e3ea8ce8-2f1f-43d2-9924-35884eec5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:00.881281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:00.950132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:01.234455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:01.235995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:01.347566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c6f2-8f34-4684-be3c-d1b584a65d41 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:01.426824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:01.427357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:01.427665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:01.427943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:01.429594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:01.480383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:01.545350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:01.546834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e26422-3daa-436a-90a8-5580604b6214 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:01.567332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 728/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:03.829456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:03.830728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:03.830728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:03.831953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:03.837484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffddc3-ad55-4995-9f04-6552fe516e42 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:03.837906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffddc3-ad55-4995-9f04-6552fe516e42 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:03.838033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffddc3-ad55-4995-9f04-6552fe516e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:03.904596 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b7ffddc3-ad55-4995-9f04-6552fe516e42 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:03.905823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b7ffddc3-ad55-4995-9f04-6552fe516e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:04.003248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:04.290306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:04.292144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:04.404323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65364b-d467-49bc-bf45-aa0792ed49d7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:04.460983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:04.480872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:04.481502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:04.481782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:04.482056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:04.483705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:04.596956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:04.598355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839fc7a-4f53-418f-a0d9-2331f044d702 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:04.617165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 732/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:06.860400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:06.860930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:06.861185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:06.862685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:06.867937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a61f-9867-4213-9a41-dd1a4044cb70 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:06.868351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a61f-9867-4213-9a41-dd1a4044cb70 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:06.868495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0a61f-9867-4213-9a41-dd1a4044cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:06.934305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88e0a61f-9867-4213-9a41-dd1a4044cb70 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:06.935533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88e0a61f-9867-4213-9a41-dd1a4044cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:06.974684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:07.036229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:07.327059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:07.328636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:07.332703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:07.437470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d85dd0-ce0c-4bb3-bae4-c2a8fcc835e7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:07.519193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:07.519807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:07.520085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:07.520358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:07.521967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:07.583266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:07.636339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:07.637780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59756589-68fa-43b0-a900-aaa60109a78d service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:07.656212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 731/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:09.884800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:09.885330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:09.885330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:09.886732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:09.892803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32286f-4dd4-4420-a9c9-9f3a39c68abd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:09.893265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32286f-4dd4-4420-a9c9-9f3a39c68abd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:09.893395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32286f-4dd4-4420-a9c9-9f3a39c68abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:09.960215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4f32286f-4dd4-4420-a9c9-9f3a39c68abd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:09.961325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f32286f-4dd4-4420-a9c9-9f3a39c68abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:10.058702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:00:10.352066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:10.353639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:10.465237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4462f9-dbab-428d-ad1a-296cdac0759a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:10.535131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:10.543217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:10.543758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:10.544039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:10.544313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:10.545993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:10.658661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:10.660157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c48344-90bd-49a0-9560-29acd2b045c8 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:10.678943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 735/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:12.880601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:12.881190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:12.881190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:12.882512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:12.887874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d31f-6990-4a6d-899a-d15d4f6430ff None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:12.888340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d31f-6990-4a6d-899a-d15d4f6430ff None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:12.888456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d31f-6990-4a6d-899a-d15d4f6430ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:12.955183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f8a7d31f-6990-4a6d-899a-d15d4f6430ff None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:12.956418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f8a7d31f-6990-4a6d-899a-d15d4f6430ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:13.005056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:13.053735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:13.351857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:13.353420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:13.367020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:13.473707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005336b9-2171-4ef8-b1ce-dcbf1f730913 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:13.561183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:13.561800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:13.562079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:13.562389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:13.564537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:13.634916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:13.678170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:13.679641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed26a8-c135-4cd9-940d-a304e52a0263 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:13.698757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 734/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:23.052229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=22 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:23.696298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=25 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:33.879412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594aa1-f6e4-484c-8293-b70295c67407 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:33.880097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594aa1-f6e4-484c-8293-b70295c67407 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:33.880097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594aa1-f6e4-484c-8293-b70295c67407 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:33.881307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 737/1471] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:33.886872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ecd-1a2c-4c7f-b8d2-4a9dc51b34a7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:33.887302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ecd-1a2c-4c7f-b8d2-4a9dc51b34a7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:33.887412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb81ecd-1a2c-4c7f-b8d2-4a9dc51b34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:33.956153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ebb81ecd-1a2c-4c7f-b8d2-4a9dc51b34a7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:33.957304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ebb81ecd-1a2c-4c7f-b8d2-4a9dc51b34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:34.052990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 735/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:34.353725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:34.354009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:34.354308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:34.355632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 738/1473] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 21 10:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:34.361296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe96b-4e2a-4a06-801e-70e12be4d0a2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:34.361616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe96b-4e2a-4a06-801e-70e12be4d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:34.362021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe96b-4e2a-4a06-801e-70e12be4d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:34.441358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d21fe96b-4e2a-4a06-801e-70e12be4d0a2 None None] MFA Rules not processed for user `4480ebef3a0f4a2cb5a2508ff9e0ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:34.442623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d21fe96b-4e2a-4a06-801e-70e12be4d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:34.463140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:34.519270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 736/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 21 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:34.527366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:34.528923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:34.637648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8c3a8-d984-42db-9045-57bdce2bf039 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:34.724751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:34.725358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:34.725638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:34.725916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:34.727555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:34.783859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:34.839511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:34.840987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b983fe3-fd21-471e-a1bc-0cb55fb5e5f6 service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:34.862955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 739/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:00:37.116370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:37.116899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:37.116899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:37.118166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 737/1476] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:37.123487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21963f-caa0-4862-be35-e06bae1f1695 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:37.123945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21963f-caa0-4862-be35-e06bae1f1695 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:37.124053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21963f-caa0-4862-be35-e06bae1f1695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:37.190761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3c21963f-caa0-4862-be35-e06bae1f1695 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:37.192094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3c21963f-caa0-4862-be35-e06bae1f1695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:37.300382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 740/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:37.572280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:37.573853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:37.701254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606a2b9-5a27-4a51-aaca-5dc4dd04b136 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:37.752783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:37.796489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:37.797579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:37.797858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:37.798129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:37.798794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:37.800534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:00:37.800534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:00:37.800534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:00:37.801670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9282e7e-103b-4cec-b599-3076e1753244 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:37.822111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 738/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Sep 21 10:00:37 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:00:40.077088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:40.077568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:40.078190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:40.079482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 741/1479] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:40.084908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8115d-1608-4e1e-b5a8-aea2adda83cb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:40.085342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8115d-1608-4e1e-b5a8-aea2adda83cb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:40.085443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8115d-1608-4e1e-b5a8-aea2adda83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:40.155497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b5a8115d-1608-4e1e-b5a8-aea2adda83cb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:40.157465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b5a8115d-1608-4e1e-b5a8-aea2adda83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:40.261639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 739/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:40.581078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:40.582707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:40.593776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:40.745004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37423a71-1464-46f3-98d0-d1d28c2ad235 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:40.832488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:40.868664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:40.869277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:40.869558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:40.869831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:40.871477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:40.961078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:40.962720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664942bc-d686-4d9f-b29b-82b910eba56f service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:40.980968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 742/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:43.397468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:43.398024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:43.398024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:43.399406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 740/1482] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:43.404917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d523f7-a3b3-4701-9086-14725436fa33 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:43.405361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d523f7-a3b3-4701-9086-14725436fa33 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:43.405473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d523f7-a3b3-4701-9086-14725436fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:43.474183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d5d523f7-a3b3-4701-9086-14725436fa33 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:43.475631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d5d523f7-a3b3-4701-9086-14725436fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:43.526639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:43.576857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 743/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:43.869411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:43.871137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:43.895356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:43.977941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679767a4-cb87-4400-b3cb-1798707ba7e9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:44.054441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:44.055053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:44.055332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:44.055603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:44.057209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:44.138448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:44.174459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:44.175884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1b4e-141d-4e78-af91-c0b90ca4ae23 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:44.195319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 741/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:46.465313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:46.465894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:46.465894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:46.467484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 744/1485] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 10:00:46.479239 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12dad-cad6-4334-9975-735a07306279 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:46.479835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12dad-cad6-4334-9975-735a07306279 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:46.479949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12dad-cad6-4334-9975-735a07306279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:46.548329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c3b12dad-cad6-4334-9975-735a07306279 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:46.549535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c3b12dad-cad6-4334-9975-735a07306279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:46.649134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 742/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:46.941321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:46.943083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:47.048926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee72c05-8cde-40c3-8bd5-8d5856100705 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:47.239144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:47.241100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:47.241806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:47.242293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:47.242628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:47.245635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:47.358548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:47.360005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bfeb5-2824-4c8b-9749-2c36cbe08a1a service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:47.378863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 745/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:49.706381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:49.706972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:49.706972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:49.708660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 743/1488] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:49.713972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a99a-2199-460e-ade5-9b7d794980b9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:49.719017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a99a-2199-460e-ade5-9b7d794980b9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:49.720847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a99a-2199-460e-ade5-9b7d794980b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:49.795471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6c98a99a-2199-460e-ade5-9b7d794980b9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:49.797206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6c98a99a-2199-460e-ade5-9b7d794980b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:49.849975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:49.893297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 746/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:50.182712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:50.184233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:50.221712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:50.291164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459388-3508-4686-a9cb-5bc869d0eb12 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:50.365283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:50.365801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:50.366077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:50.366376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:50.367964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:50.448001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:50.477252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:50.478707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b37d4-ed37-4c7a-9c68-0c000585c255 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:50.500342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 744/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:00:52.924142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:52.924704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:52.924704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:52.926060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 747/1491] 10.222.0.20 () {54 vars in 927 bytes} [Wed Sep 21 10:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:00:52.931637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700c40-6f62-425f-900a-fa29b96f2ce8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:52.932052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700c40-6f62-425f-900a-fa29b96f2ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:52.932191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700c40-6f62-425f-900a-fa29b96f2ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:52.999569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0b700c40-6f62-425f-900a-fa29b96f2ce8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:00:53.000687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0b700c40-6f62-425f-900a-fa29b96f2ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:53.097149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 745/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Sep 21 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:00:53.394097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:00:53.395658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:53.503071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaafdfd-b860-43db-8fb9-71e5da522624 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:00:53.576966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:00:53.577574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:00:53.577853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:00:53.578125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:00:53.579757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:00:53.588480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:00:53.688571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:00:53.689921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ac5fd-1d29-4deb-a379-09f6f3726a7b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:00:53.709293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 748/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:01:03.095696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=82 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:01:03.706651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=50 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:14.231891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:14.232510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:14.232510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:14.309277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:02:14.310546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:14.408128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 746/1494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:02:14.416208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:14.417212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:14.417325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:14.493325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:02:14.494586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:14.592094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 749/1495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:02:14.596730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:14.597943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:14.609927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda986-bfee-40a9-bb95-8ce655a66eb2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:14.672274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:14.710924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:14.711542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:14.711818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:14.712087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:14.712761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:02:14.713064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:14.714588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:14.714588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:02:14.714588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:02:14.715798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:14.727094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 747/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:02:14.736164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:14.746709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed9a52-5263-42b3-b76b-f43ad0cf0e28 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:14.821761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:14.856825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:14.857517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:14.857713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:14.857984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:14.858694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:14.860442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:14.860442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:02:14.860442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:02:14.861637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:14.922250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 750/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:02:14 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:02:14.926696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:14.928172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:14.962401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8b8a-0b89-4b4d-8f70-e439a79ea2fa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:15.060346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:15.060958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.061237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.061509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.062147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:15.063189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:15.063189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:02:15.063189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:02:15.064387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:15.111409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 748/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:02:14 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:02:15.115824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:15.117436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:15.189142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41508a-cb21-4f1d-8047-971f54ff71cc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:15.289709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:15.301940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:15.302580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.302857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.303125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.303768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:15.304787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:15.304787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:02:15.304787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:02:15.305667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:15.319185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 751/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:02:15.324008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:15.325536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:15.336970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548c88-d01d-4ed3-b85e-b162ca3797da admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:15.362674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:15.438481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:15.439092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.439426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.439641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.440291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:15.441574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:15.441574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:02:15.441574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:02:15.442198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692df6-ef42-45d9-92cf-d93c8a2b53a6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:15.456265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 749/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:02:15.460810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:15.462518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:15.499277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8f308-3cd9-4877-a560-0086c8c5e0df admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:15.597143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:15.597804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.598081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.598391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] PATH_INFO: `/v3/projects/e92402d6d16a406f9f4ce4a87840d378/users/d39d55909fac4471b93f7ac7320dca49/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.622558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92402d6d16a406f9f4ce4a87840d378, user_id=d39d55909fac4471b93f7ac7320dca49, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:15.623615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:15.623615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:02:15.623615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:02:15.625555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f400-9895-405f-8d98-538def43d2ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:15.650961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 752/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:02:15 2022] PUT /identity/v3/projects/e92402d6d16a406f9f4ce4a87840d378/users/d39d55909fac4471b93f7ac7320dca49/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:02:15.664203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fca8-7304-47a7-b904-27775b4dbef8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.664519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fca8-7304-47a7-b904-27775b4dbef8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.664913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254fca8-7304-47a7-b904-27775b4dbef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.728799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9254fca8-7304-47a7-b904-27775b4dbef8 None None] MFA Rules not processed for user `d39d55909fac4471b93f7ac7320dca49`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:02:15.730576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9254fca8-7304-47a7-b904-27775b4dbef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:15.813669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 750/1502] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:02:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:02:15.835231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.835523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.835803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.837411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 753/1503] 10.222.0.20 () {54 vars in 962 bytes} [Wed Sep 21 10:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:02:15.842686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed8ec-3e19-4f99-ba31-9e67f1e67579 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:15.842975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed8ec-3e19-4f99-ba31-9e67f1e67579 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:15.843256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeed8ec-3e19-4f99-ba31-9e67f1e67579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:15.878162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:15.925460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fbeed8ec-3e19-4f99-ba31-9e67f1e67579 None None] MFA Rules not processed for user `97c7227deb9048398d33ff330b8df8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:02:15.926717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fbeed8ec-3e19-4f99-ba31-9e67f1e67579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:16.005714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 751/1504] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Sep 21 10:02:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:02:16.015612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:16.017160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:16.068549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:16.125967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769030e-5fe4-47cb-a5d8-1eedd64ce86e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:16.214260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:16.214877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:16.215411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:16.215678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:16.217277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:16.317964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:16.319342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:16.322872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:16.337822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 754/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:02:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:02:16.385257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40188-fe10-4935-bc2d-b420abdc6a44 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:16.386267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40188-fe10-4935-bc2d-b420abdc6a44 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:16.386401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40188-fe10-4935-bc2d-b420abdc6a44 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:16.387663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 752/1506] 10.222.0.20 () {52 vars in 830 bytes} [Wed Sep 21 10:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:02:16.391461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:16.392688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:16.503877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f430-1f5c-4b98-ab15-1017e6913c33 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:16.601371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:16.601919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:16.602200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:16.602504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] PATH_INFO: `/v3/users/d39d55909fac4471b93f7ac7320dca49` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:16.615919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39d55909fac4471b93f7ac7320dca49)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:16.616959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:16.616959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:02:16.616959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:02:16.618179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:16.628416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:16.696438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39d55909fac4471b93f7ac7320dca49'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:16.696877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39d55909fac4471b93f7ac7320dca49'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:16.716168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39d55909fac4471b93f7ac7320dca49'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:16.740227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39d55909fac4471b93f7ac7320dca49'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:16.740813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39d55909fac4471b93f7ac7320dca49'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:16.758155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 755/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:02:16 2022] DELETE /identity/v3/users/d39d55909fac4471b93f7ac7320dca49 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:02:16.763419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:16.763708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:16.764005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:16.835793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:02:16.837008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:16.917457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:16.931422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 753/1508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:02:16.941915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:16.943221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:17.059379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea5e7f-d4ad-43d3-9eec-fa6d27533244 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:17.116719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:17.145091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:17.145723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:17.146005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:17.146310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:17.148070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:17.263745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:17.265257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad5171-0d29-41ca-8918-9649a8610ba5 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:17.285279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 756/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:02:17.663282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:02:17.664523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:02:17.677630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b55dfd-f9ca-488c-9efb-da24c7d67d9c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:02:17.791136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:02:17.792353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:02:17.792635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:02:17.792912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] PATH_INFO: `/v3/projects/e92402d6d16a406f9f4ce4a87840d378` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:02:17.803236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92402d6d16a406f9f4ce4a87840d378)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:02:17.804261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:02:17.804261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:02:17.804261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:02:17.805466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:02:17.865322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92402d6d16a406f9f4ce4a87840d378', 'request_id': 'req-395cf4ac-5611-4984-a062-95b987df3bc4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:17.879279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92402d6d16a406f9f4ce4a87840d378', 'request_id': 'req-395cf4ac-5611-4984-a062-95b987df3bc4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:17.890916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92402d6d16a406f9f4ce4a87840d378', 'request_id': 'req-395cf4ac-5611-4984-a062-95b987df3bc4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:17.914768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] The token cache is being invalidate because project e92402d6d16a406f9f4ce4a87840d378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:02:17.915053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:17.915571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-395cf4ac-5611-4984-a062-95b987df3bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:02:17.916893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 754/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:02:17 2022] DELETE /identity/v3/projects/e92402d6d16a406f9f4ce4a87840d378 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:02:27.282841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=62 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:02:27.912730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:03:56.031893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:56.032444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:56.032444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:56.033993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 10:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:03:56.041395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ccf4-4022-43ad-ab20-0bf8b4db3cd1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:56.041395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ccf4-4022-43ad-ab20-0bf8b4db3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:56.041395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ccf4-4022-43ad-ab20-0bf8b4db3cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:56.129471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-28e6ccf4-4022-43ad-ab20-0bf8b4db3cd1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:03:56.130744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-28e6ccf4-4022-43ad-ab20-0bf8b4db3cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:03:56.248315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:03:56.403261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:03:56.405389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:03:56.533535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a621a-94e2-4c75-bc04-c09d0aa01b84 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:03:56.540156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:03:56.540811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:56.541094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:56.541368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:56.551005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:03:56.552667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff01c8-f684-409d-8fa1-2a72cb293531 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:03:56.563828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 758/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:03:57.235068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6ca1-d5b8-4e96-adfb-18fcc8a9267e None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:57.235649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6ca1-d5b8-4e96-adfb-18fcc8a9267e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:57.235649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d6ca1-d5b8-4e96-adfb-18fcc8a9267e None None] PATH_INFO: `/v3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:57.236939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 756/1514] 10.222.0.60 () {54 vars in 925 bytes} [Wed Sep 21 10:03:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:03:57.242887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2dd-619a-4b28-b691-e01e96c19584 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:57.243548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2dd-619a-4b28-b691-e01e96c19584 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:57.243548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d2dd-619a-4b28-b691-e01e96c19584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:57.305279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3024d2dd-619a-4b28-b691-e01e96c19584 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:03:57.306523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3024d2dd-619a-4b28-b691-e01e96c19584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:03:57.374288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:03:57.380547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 759/1515] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Sep 21 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:03:57.652647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1feda-01e6-4bcd-8c57-fa0dedd28adf None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:57.652940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1feda-01e6-4bcd-8c57-fa0dedd28adf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:57.653217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1feda-01e6-4bcd-8c57-fa0dedd28adf None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:57.654628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 10:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:03:57.660939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9bdf6-f923-4d2d-ac3a-6fa98fee2aa6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:57.661220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9bdf6-f923-4d2d-ac3a-6fa98fee2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:57.661493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9bdf6-f923-4d2d-ac3a-6fa98fee2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:57.680744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c7e9bdf6-f923-4d2d-ac3a-6fa98fee2aa6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:03:57.681957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c7e9bdf6-f923-4d2d-ac3a-6fa98fee2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:03:57.689722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:03:57.846372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1feda-01e6-4bcd-8c57-fa0dedd28adf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:03:57.860805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1feda-01e6-4bcd-8c57-fa0dedd28adf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:03:57.866192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:03:57.866818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:03:57.867128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:03:57.867404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:03:57.875513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:03:57.877078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197ef92-5a51-4963-b6ee-79cb983c91dd service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:03:57.887108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 758/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:06.287358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285496-157b-444b-a8b1-d3f1c354fd4d None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:06.287848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285496-157b-444b-a8b1-d3f1c354fd4d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:06.287955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285496-157b-444b-a8b1-d3f1c354fd4d None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:06.289873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 761/1519] 10.222.0.20 () {54 vars in 961 bytes} [Wed Sep 21 10:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:06.295029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9657d-28e4-4a38-9a2e-fabc5f4aa01c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:06.295509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9657d-28e4-4a38-9a2e-fabc5f4aa01c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:06.295627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9657d-28e4-4a38-9a2e-fabc5f4aa01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:06.315148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fdd9657d-28e4-4a38-9a2e-fabc5f4aa01c None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:06.316353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fdd9657d-28e4-4a38-9a2e-fabc5f4aa01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:06.325254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 759/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Sep 21 10:04:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:06.333105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285496-157b-444b-a8b1-d3f1c354fd4d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:06.347228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285496-157b-444b-a8b1-d3f1c354fd4d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:06.352718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:06.353318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:06.353593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:06.353861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:06.362056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:06.363668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b48d35-c63e-446e-aa41-c6eb95f1f0e3 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:06.373260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 762/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:09.396343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2080de-57cf-44c0-83bb-dc02659beca7 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:09.396895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2080de-57cf-44c0-83bb-dc02659beca7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:09.396895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2080de-57cf-44c0-83bb-dc02659beca7 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:09.398809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 10:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 10:04:09.405296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb31a8-1680-4f9e-8981-29f0c2dda47d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:09.405767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb31a8-1680-4f9e-8981-29f0c2dda47d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:09.405871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb31a8-1680-4f9e-8981-29f0c2dda47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:09.426377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-18cb31a8-1680-4f9e-8981-29f0c2dda47d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:09.427817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-18cb31a8-1680-4f9e-8981-29f0c2dda47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:09.436688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:09.593284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2080de-57cf-44c0-83bb-dc02659beca7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:09.608330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2080de-57cf-44c0-83bb-dc02659beca7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:09.613959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:09.614597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:09.614881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:09.615156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:09.623520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:09.625097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d2e4-a356-40d8-9b86-aba8b26b892a service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:09.635241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 761/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:10.727453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d874-8383-4638-8abc-48feb3bf6dc3 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:10.727956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d874-8383-4638-8abc-48feb3bf6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:10.728065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942d874-8383-4638-8abc-48feb3bf6dc3 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:10.729348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 10:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:10.735623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52151-b388-4749-b328-c2f9ce0b9236 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:10.736068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52151-b388-4749-b328-c2f9ce0b9236 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:10.736181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52151-b388-4749-b328-c2f9ce0b9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:10.755841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a5a52151-b388-4749-b328-c2f9ce0b9236 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:10.757039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5a52151-b388-4749-b328-c2f9ce0b9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:10.764900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:10.919382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942d874-8383-4638-8abc-48feb3bf6dc3 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:10.933631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942d874-8383-4638-8abc-48feb3bf6dc3 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:10.939056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:10.939654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:10.939935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:10.940210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:10.948225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:10.949829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e257c15-b513-49f7-88b1-87fe8925e23b service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:10.959228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 765/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:15.089425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:15.089995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:15.089995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:15.091278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:15.096500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1dd3-e92e-4ae9-b050-a88873a77973 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:15.096932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1dd3-e92e-4ae9-b050-a88873a77973 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:15.097042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1dd3-e92e-4ae9-b050-a88873a77973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:15.117202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-188b1dd3-e92e-4ae9-b050-a88873a77973 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:15.118445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-188b1dd3-e92e-4ae9-b050-a88873a77973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:15.126204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:15.416921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:15.418686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:15.451451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:04:15.497800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c55f-4f13-4136-8386-75860e464da0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:15.501418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:15.502028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:15.502348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:15.502623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:15.511594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:15.513029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aef9b-3287-4876-920f-01ee95621929 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:15.522417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 764/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:17.675917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d5f1-43f2-48be-bf7e-155483f4de52 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:17.676500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d5f1-43f2-48be-bf7e-155483f4de52 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:17.676500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62d5f1-43f2-48be-bf7e-155483f4de52 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:17.677842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:17.683803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec030b-18d3-46fa-9251-958f166af9df None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:17.684266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec030b-18d3-46fa-9251-958f166af9df None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:17.684370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec030b-18d3-46fa-9251-958f166af9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:17.704462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-90ec030b-18d3-46fa-9251-958f166af9df None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:17.705658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-90ec030b-18d3-46fa-9251-958f166af9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:17.713621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:18.001996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d5f1-43f2-48be-bf7e-155483f4de52 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:18.012924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62d5f1-43f2-48be-bf7e-155483f4de52 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:18.016460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:18.017059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:18.017336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:18.017605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:18.026626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:18.028102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c07db-538b-4833-9c33-ada0bb60063f service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:18.037488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 768/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:21.751331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:21.751904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:21.751904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:21.753286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:21.758761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fab15-bcce-4321-9e54-7fd0fcb5589f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:21.759204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fab15-bcce-4321-9e54-7fd0fcb5589f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:21.759306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fab15-bcce-4321-9e54-7fd0fcb5589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:21.778636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dd3fab15-bcce-4321-9e54-7fd0fcb5589f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:21.779843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd3fab15-bcce-4321-9e54-7fd0fcb5589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:21.787884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:04:22.088916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:22.090898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:22.171580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e95a-5da3-47ac-84f7-0bbcef4c203f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:22.175315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:22.177190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:22.177190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:22.177190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:22.185887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:22.187376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de66fe8-6849-4f7a-ae14-1809accfa027 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:22.196788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 767/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:24.338747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:24.339512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:24.339512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:24.340863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 10:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:04:24.346143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa06e1-bc75-47fb-b4fd-ee9d2a4cc030 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:24.346589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa06e1-bc75-47fb-b4fd-ee9d2a4cc030 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:24.346739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa06e1-bc75-47fb-b4fd-ee9d2a4cc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:24.366498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-76aa06e1-bc75-47fb-b4fd-ee9d2a4cc030 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:04:24.367703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-76aa06e1-bc75-47fb-b4fd-ee9d2a4cc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:24.375540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:04:24.678471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:04:24.680219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:04:24.693972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c162a6-3535-4ff6-ad7a-16c601e74f8c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:04:24.698093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:04:24.698846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:04:24.699075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:04:24.699351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:04:24.712050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:04:24.713585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5759f8-8aa4-4cac-a6b3-298bdd26c81e service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:04:24.723811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 771/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:04:34.361587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=63 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:04:34.719461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=37 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:03.158936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840834c-4add-4a5f-9e8e-c9100137817a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.159892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840834c-4add-4a5f-9e8e-c9100137817a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.159892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840834c-4add-4a5f-9e8e-c9100137817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.195374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b840834c-4add-4a5f-9e8e-c9100137817a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:03.196632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b840834c-4add-4a5f-9e8e-c9100137817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:03.211020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 769/1540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:03.220525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.221434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.221434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.254359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4df93-df6d-4916-9b37-ef15d332e85f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.254661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4df93-df6d-4916-9b37-ef15d332e85f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.254894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4df93-df6d-4916-9b37-ef15d332e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.256085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:03.257454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:03.287814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 772/1541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:03.294766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-56d4df93-df6d-4916-9b37-ef15d332e85f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:03.296064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-56d4df93-df6d-4916-9b37-ef15d332e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:03.300047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.315437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e2cb2-b2a4-40f6-b106-a24a898f9e9e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.326850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 770/1542] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 21 10:06:03.327559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.328208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.328491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.328761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.329443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:03.329749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.330940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:03.330940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:06:03.330940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:06:03.331863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.335005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.335312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.335635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.372394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 773/1543] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:06:03.383455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:03.385553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:03.389272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.400189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621502a6-ba9e-42ed-80f8-61823abc77fb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.413319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.414917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.415758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.416521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.417925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.420243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 771/1544] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:03.422928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.425363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.441892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb234-4fd0-40a7-b8b5-14f0295a69b5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.463067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.463712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.464250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.464526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.465186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:03.465497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.467242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.495775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 772/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:03.504444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.522134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985962f7-87b7-4bd1-bdc3-8c7c16ee1a7f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.540456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 774/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:03.543807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.544449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.544725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.544987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.545640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.546701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:03.546701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:06:03.546701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:06:03.547930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.554666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.614133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 773/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:06:03.619512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.745588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27197-bd51-4462-aa25-b8493a5c164c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.785579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a8bc-5d0a-483a-a07b-bfa710a2c6cd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.803801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.804467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.804757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.805040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.805719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.807792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.858606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.859259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.859546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.859862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.860707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.861256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 774/1548] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:06:03.861767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:03.861767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:06:03.861767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:06:03.863107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.866396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.892836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb67-f9f2-48b7-88ba-e25e12027dd6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.903140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 775/1549] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/users => generated 295 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:03.909197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.909851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.910159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.910448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.911097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.913627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.914661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.932790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 775/1550] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:03.933063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcda48-c881-46ca-875f-a5ed65705f02 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.939939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:03.945259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.945915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.946196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.946499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.947229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.948908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be5ce7-571d-4391-87e9-42a1f3021b9a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:03.962663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dae1f2-2ba6-4717-ab36-93e9dc01a30e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:03.982749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 776/1551] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:06:03.983349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:03.984023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.984287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:03.984470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.984635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:03.984779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.984936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:03.985263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:03.986923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.018226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 776/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:04.019355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.028303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.029581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.044407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984382-02e7-4702-832c-ad16a7782b48 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.046769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 777/1553] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.047821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.069204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.069854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.070162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.070443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.071119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.072872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378475-e047-4c47-b6f2-e65950723efb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.073217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8eb9-60bd-4534-b50c-8b94e4fdc84a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.108483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 777/1554] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:04.108792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.108792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.108792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.108792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] PATH_INFO: `/v3/projects/fbc45b3c42e44f41b02fd4e3035719f3/users/1587552a5e6d47f0af519679a08f7300/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.109426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.109426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.109426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.154038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.156206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.166600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc45b3c42e44f41b02fd4e3035719f3, user_id=1587552a5e6d47f0af519679a08f7300, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.173866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fe47c-8c2e-44ee-aa5c-5cdd6342b9b6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.180845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 778/1555] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.183819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.211320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16fc1d-819c-4f2e-9609-66418d0fea60 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.228877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 778/1556] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:04 2022] PUT /identity/v3/projects/fbc45b3c42e44f41b02fd4e3035719f3/users/1587552a5e6d47f0af519679a08f7300/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:04.238297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.239435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.241791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.264351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:04.291402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.292686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.338730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:04.369875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.370657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.370941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.371240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] PATH_INFO: `/v3/projects/72490f945ddb4461bce36c80faeaa059/users/680128c3fd934178b5d8d1370bb3729f/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.392028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72490f945ddb4461bce36c80faeaa059, user_id=680128c3fd934178b5d8d1370bb3729f, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.393216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:04.393216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:06:04.393216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:06:04.395510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e6b9e-85a6-4fec-8718-a90506850948 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.416331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 779/1557] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:04 2022] PUT /identity/v3/projects/72490f945ddb4461bce36c80faeaa059/users/680128c3fd934178b5d8d1370bb3729f/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:04.418308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554aef8-f809-4c1c-aff9-99e85577b083 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.418658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554aef8-f809-4c1c-aff9-99e85577b083 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.418998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554aef8-f809-4c1c-aff9-99e85577b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.421568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 779/1558] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.427697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.448786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805988e-003e-4b4a-b9e5-da335808c930 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.461762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e554aef8-f809-4c1c-aff9-99e85577b083 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.464955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e554aef8-f809-4c1c-aff9-99e85577b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.523180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.523913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.524213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.524630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.525330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:04.525637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.527650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7628-7e24-451e-89db-cb5e8d0d3609 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.543773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 780/1559] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:04.550547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928f1a2-5ba0-4f57-aa96-3de06fd71405 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.550933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928f1a2-5ba0-4f57-aa96-3de06fd71405 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.551293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928f1a2-5ba0-4f57-aa96-3de06fd71405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.582294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8928f1a2-5ba0-4f57-aa96-3de06fd71405 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.583690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8928f1a2-5ba0-4f57-aa96-3de06fd71405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.593916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 781/1560] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.599007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e104-42d3-4de6-98fe-6599eca6fe30 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.599326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e104-42d3-4de6-98fe-6599eca6fe30 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.600151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657e104-42d3-4de6-98fe-6599eca6fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.629504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b657e104-42d3-4de6-98fe-6599eca6fe30 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.630808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b657e104-42d3-4de6-98fe-6599eca6fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.636989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 780/1561] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.640552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 782/1562] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.641715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.641938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20812a-3475-42d3-b862-c1c1a3198d54 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.642107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.642506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20812a-3475-42d3-b862-c1c1a3198d54 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.642689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.642871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20812a-3475-42d3-b862-c1c1a3198d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.673427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fb20812a-3475-42d3-b862-c1c1a3198d54 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.674198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.675312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fb20812a-3475-42d3-b862-c1c1a3198d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.675467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.684155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 783/1563] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.685099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.689386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 781/1564] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.694929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90414f-6c7c-4051-abec-557c42ec8b7a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.697209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90414f-6c7c-4051-abec-557c42ec8b7a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.698542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90414f-6c7c-4051-abec-557c42ec8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.700650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ea0c-372a-4670-84ff-fcdad4c60083 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.714614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.715317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.715601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.715879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.716578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.718695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.754722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3e90414f-6c7c-4051-abec-557c42ec8b7a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.756682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3e90414f-6c7c-4051-abec-557c42ec8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.763596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 784/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:04.764670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.768449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 782/1566] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.777724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f6c22-c4e9-4190-81e5-15a4474fe77a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.777724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f6c22-c4e9-4190-81e5-15a4474fe77a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.778229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f6c22-c4e9-4190-81e5-15a4474fe77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.802593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-594f6c22-c4e9-4190-81e5-15a4474fe77a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.804071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-594f6c22-c4e9-4190-81e5-15a4474fe77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.838659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25e37-e735-4744-bb18-7804130cc20c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.843471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.844210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.844510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.844865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.857657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:04.880567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 783/1567] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.882196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.882622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.883000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.907572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:04.908891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:04.918292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 784/1568] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:04.919102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.929467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0000f9-8d20-4dc2-9729-1b314f4c1b28 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.937874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.938190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.939070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.939537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.939984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.940545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.941063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:04.941555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:04.944650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d0605-f947-4471-90e1-e91b99243799 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:04.958053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 785/1569] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:04.960179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:04.978279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 785/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:04.978279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.978279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.978279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:04.979059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37dcfb-28c5-4d0d-98b8-0fafbba324af service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:04.982770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:04.983777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:04.985272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:04.985742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.004864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:05.005217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.007557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:05.008450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05509a1-66a4-41fc-a016-68a1fe77a64a service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.028145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 786/1571] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:05.030093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.032063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 786/1572] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:05.034063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.034526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.034941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.050567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccc960-7202-4597-ad79-fa2665c8285a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.058352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.059285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.059798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.060369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.061339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.064126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.072851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:05.075234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:05.094650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 787/1573] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:05.096166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.109519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 787/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/users => generated 291 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.112142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.113295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56e02-6856-43a3-82ca-edbf6145b036 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.120955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.121938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.122465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.122972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.124312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:05.124905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.128603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.132635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2c98-f2e6-4f3a-9020-859814f06f4d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.141874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.142946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.144490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.144490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.145473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:05.146394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.149584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859563df-350c-461d-a150-d79e35258f26 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.165024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 788/1575] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:05.165024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.177025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 788/1576] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:05.178981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.179494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.179972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.184360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265d7d-a3d8-4e9b-b857-52f34c861d90 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.203069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.204742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.205493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.206138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.207654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.211949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.222782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:05.225931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:05.246437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 789/1577] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:05.246437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.259524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:05.268828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f359a-8002-4b5f-811a-1b27a70f50f8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.278292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.280058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.280737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.281261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.282286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 789/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.285474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.286925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:05.288020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.291511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.322958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 790/1579] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:05.325600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.348723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7796-cce2-47f4-90f0-b0f5e85a5935 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.427156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c550db-3805-4c91-a469-128c0f5f626a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.436114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.436704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.437399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.437894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.439231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.447566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.473692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 790/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:05.475330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.481121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.481663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.481939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.482313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.482933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.486061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.497927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d22264-f20a-48c1-a2be-39a931332632 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.509022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.510208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.510863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.511444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.512751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.516860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.553580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 791/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.559671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.577324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 791/1582] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.583875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.637213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:05.690999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31f80-011a-44a9-ad8c-ef3a065b849d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.701979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.703148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.703638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.704290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.705513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:05.706037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.709725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.719574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea1fa-2c4c-432a-b23f-39ecaf531c1a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.731953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.733001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.733492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.733939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.738448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.738920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 792/1583] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:05.738920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.739679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.768940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35e44a-046b-4dee-965b-a87496e0b711 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.778201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.779427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.779894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.780344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.781675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.786141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 792/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.786591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.787885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.808777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81bd9-9de8-453b-a0d8-46b3ca119f04 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.819110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.820566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.821026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.821477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.822645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.826555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.851398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 793/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:05.851398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.862449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56025d-8b83-4004-8128-a36390cd65bb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:05.868285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 793/1586] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.868521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:05.869253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:05.869536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:05.869815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:05.870638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:05.870940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.872858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:05.911075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 794/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:05.911950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:05.946999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8711-5d9e-4aca-b8b6-31acc43b623a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.018052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:06.089517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc210-81ee-45c9-b3a4-a0422feffa7b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.117111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.119321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.119641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.120116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.120981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.122093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.122697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.122904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.123994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.124478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.128884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.136092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.204481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 794/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:06.204481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.206727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 795/1589] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:05 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:06.208304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.273953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18b9ff-0c3e-40d3-9f46-157660479c0b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.367912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb59b-6bea-4ef5-8f8b-58c026bf3b2c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.379722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.382669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.383376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.383997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] PATH_INFO: `/v3/projects/5a9e74cfd61749fca9cfdbd1f7ff11c4/users/5b5495088ff84791bf0c63fdd21634fe/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.426953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9e74cfd61749fca9cfdbd1f7ff11c4, user_id=5b5495088ff84791bf0c63fdd21634fe, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.437242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.445407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:06.486296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 796/1590] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:06 2022] PUT /identity/v3/projects/5a9e74cfd61749fca9cfdbd1f7ff11c4/users/5b5495088ff84791bf0c63fdd21634fe/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:06.486296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.486788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.486788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.486788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.486788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.487426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.494365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.522661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 795/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:06.525026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.557770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ded1a5-9883-4422-8146-ee5cd3e14d6d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.654169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ea1d-e8e2-41bb-95c7-962e9b6f3170 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.684838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.686293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.687116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.687617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.690170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.695432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.721478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.723536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.723964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.724434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.732666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.738043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.764730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 797/1592] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:06 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:06.767564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.773787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 796/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:06.775853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.798400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dc146-19b7-4778-aa15-4577dcadc582 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.805680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebcc2a-cd00-4bea-887b-2c8de60727a5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.814860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.817506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.818199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.819479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.820035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.821422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.821641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.823516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.824725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.824924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcba000-63be-454f-85db-077fec3a4fd7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.830455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.839635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.856650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 798/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:06.865112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.866073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.866609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.914687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 797/1595] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:06 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:06.917288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.939253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af9788-78fe-4701-9b75-af2e0333451c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:06.951348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:06.951348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:06.951836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:06.952310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:06.953337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:06.955973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:06.970366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 798/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:06.971285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:06.986344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] MFA Rules not processed for user `5b5495088ff84791bf0c63fdd21634fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:06.988789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:06.998484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4b51-597a-4c83-b81e-0559f3371a24 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.014812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.018313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.019148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.019584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.022213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.028793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.056288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 799/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:07.069013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.093975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbd65-225b-4590-820b-87296cfe8b6e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.105959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.108862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.109736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.113093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.114139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.116564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.145018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 800/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:07.147213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.167560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235e7f-e8bc-4ba5-9645-acf2127593b9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.183178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.185730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.186140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.186542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.188374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.190232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.203622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 799/1599] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:07.204772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.225513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafb5b-fd6a-4f97-98e6-bd2ff44acc00 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.230823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.231621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.232141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.232518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.233331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.235164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.245452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 801/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:07.247105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.254173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 800/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:07.255302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.269341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d88262-b95d-41f3-9fa4-51d8f763d3c8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.275323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.276066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.276399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.276765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.277516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.279468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.295637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 801/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:07.297084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.300027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1668c3-6685-4e18-8135-f05e6a0f3142 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.311149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.312333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.313927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.313927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] PATH_INFO: `/v3/projects/40c11feb98d948e8ae98c0a551260f1f/users/7ca9ead0e8344447bc376f1568b39722/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.320392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:07.320846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c533-9718-4175-97a9-e063f4548c0f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.338380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.339911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.340593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.340946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] PATH_INFO: `/v3/projects/87b398e61c694a2ba863a48edf6ea4ed/users/5a424b3a933741549c26a4ffc5ecaf93/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.348318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c11feb98d948e8ae98c0a551260f1f, user_id=7ca9ead0e8344447bc376f1568b39722, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.353092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.378445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 802/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:07 2022] PUT /identity/v3/projects/40c11feb98d948e8ae98c0a551260f1f/users/7ca9ead0e8344447bc376f1568b39722/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:07.379881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.403048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b398e61c694a2ba863a48edf6ea4ed, user_id=5a424b3a933741549c26a4ffc5ecaf93, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.409315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.449337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 802/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:07 2022] PUT /identity/v3/projects/87b398e61c694a2ba863a48edf6ea4ed/users/5a424b3a933741549c26a4ffc5ecaf93/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:07.452963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.543005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:07.609648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc40ed-6839-47b8-a8bf-02d57fd77ba5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.715207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec381e1-5e78-476f-bc1b-2d34a975fd15 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:07.729124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.730427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.731403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.732016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] PATH_INFO: `/v3/projects/af074a55acaf4cc7acb9dd1e2e5d50ed/users/b3493c19a0c5463cb536583401c7d22e/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.771863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af074a55acaf4cc7acb9dd1e2e5d50ed, user_id=b3493c19a0c5463cb536583401c7d22e, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.780440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.817469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:07.820127 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:07.820915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:07.821681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:07.822314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 803/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:07 2022] PUT /identity/v3/projects/af074a55acaf4cc7acb9dd1e2e5d50ed/users/b3493c19a0c5463cb536583401c7d22e/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:07.823655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:07.827795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:07.832822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:07.902547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 803/1606] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:07 2022] POST /identity/v3/projects => generated 381 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:07.903844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:08.055210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058af02-0ffe-4f7a-98cd-3b226e04b518 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.110664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84018-61b3-46c5-b4c5-40e75af236ca admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.121958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:08.122991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.123963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.125774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] PATH_INFO: `/v3/projects/54661ad4d0cc49449d4b424e345c0637/users/f0096ff6416148d4a75e70393efec73a/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.157777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54661ad4d0cc49449d4b424e345c0637, user_id=f0096ff6416148d4a75e70393efec73a, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:08.163751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74313-d91e-4e38-b036-130fcb738161 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:08.181809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:08.196436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 804/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:07 2022] PUT /identity/v3/projects/54661ad4d0cc49449d4b424e345c0637/users/f0096ff6416148d4a75e70393efec73a/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:08.204195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885356e-a451-4f69-afab-7c2f855403cb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.205240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885356e-a451-4f69-afab-7c2f855403cb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.205799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:08.206451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885356e-a451-4f69-afab-7c2f855403cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.207630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.210140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.210674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.211555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:08.218620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3ec7-784d-44a3-9293-8ffe164377a2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:08.250704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 804/1608] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:08.254966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178925ea-fc35-4a5e-9e0b-ad6610ead2eb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.265204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178925ea-fc35-4a5e-9e0b-ad6610ead2eb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.266349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178925ea-fc35-4a5e-9e0b-ad6610ead2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.324712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1885356e-a451-4f69-afab-7c2f855403cb None None] MFA Rules not processed for user `7ca9ead0e8344447bc376f1568b39722`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:08.333637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1885356e-a451-4f69-afab-7c2f855403cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:08.354890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-178925ea-fc35-4a5e-9e0b-ad6610ead2eb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:08.357430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-178925ea-fc35-4a5e-9e0b-ad6610ead2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:08.461156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:08.527401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 805/1609] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:08.530287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.531087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.531418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.574496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:08.576597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:08.592881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 806/1610] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:08.594777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:08.608466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 805/1611] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:08.608466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.615919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.616646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.633353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4fb71-9225-4e83-a58d-c21dd1f1a9b0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.640512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:08.641247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.641536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.641810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.643161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:08.645380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:08.687376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:08.693773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:08.699104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 807/1612] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:08.699104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:08.730793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 806/1613] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:08.734182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:08.739233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887d5f2-b45f-4037-ac20-bf9fe10cdbfb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.759779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:08.761238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.761524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.763763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] PATH_INFO: `/v3/projects/ef3d122c41e440859a038830d5ccaf82/users/e6dd4fa05e994c8aaa34360fce0123cd/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.805093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3d122c41e440859a038830d5ccaf82, user_id=e6dd4fa05e994c8aaa34360fce0123cd, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:08.808298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:08.838212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 808/1614] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:08 2022] PUT /identity/v3/projects/ef3d122c41e440859a038830d5ccaf82/users/e6dd4fa05e994c8aaa34360fce0123cd/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:08.839795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:08.877332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172b99-6c5b-4711-be08-b71c4333ac5c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.967515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846fecf-16e3-4577-a601-83ae7a2ef193 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:08.979705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:08.980364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:08.980648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:08.980928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:08.981619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:08.985195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.052757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 809/1615] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:08 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:09.052757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.089792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.090691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.091155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.091614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.127799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.131839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.160579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 807/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:09.170560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.176117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:09.199583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b94dd-f536-4938-8142-49e0b929db8b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.206054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c2293-0100-49db-bcec-59b7f3d44512 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.234960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.235864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.237130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.237459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.238334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.241394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc28963-7365-40a8-aa9b-c73485d24eae admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.288290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 810/1617] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:09.289450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.289751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.290032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.391416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] MFA Rules not processed for user `e6dd4fa05e994c8aaa34360fce0123cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:09.393464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:09.409421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:09.437518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:09.517665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 811/1618] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:09.519548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.525951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.527023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.527537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.528046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.533993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9c4a-04d1-405b-9c18-6b84d646f318 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.539684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.540663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.541255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.541715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.557373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.561698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.564832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.567445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.597935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 812/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:09.599121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.615792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 808/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:09.617652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.625583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac4b9-3f92-4afd-8eae-2752964bc71e service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.633252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.634847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.634847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.634847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.641687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.645052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7343-b1d1-44f4-bf26-54014e811d5f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.690296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2afc-a76e-4ea9-8526-6b1d105d7bc4 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.710154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.717416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.717768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.718059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] PATH_INFO: `/v3/projects/ca251d655c4843bd9138fb983ccaadd5/users/8b1c2963604a4a7ba5329b3d4a4bdacc/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.731564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 813/1621] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:09 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:09.733198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e01d-ebe7-4ee7-919d-c353cf2b68b6 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.733569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e01d-ebe7-4ee7-919d-c353cf2b68b6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.734074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e01d-ebe7-4ee7-919d-c353cf2b68b6 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.737051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 814/1622] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 21 10:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:09.738339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e01d-ebe7-4ee7-919d-c353cf2b68b6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.744629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca251d655c4843bd9138fb983ccaadd5, user_id=8b1c2963604a4a7ba5329b3d4a4bdacc, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.748048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d640499-dd27-462e-91ea-66edecb64844 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.767090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e01d-ebe7-4ee7-919d-c353cf2b68b6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.773265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.774028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.774326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.774911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.775998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.778523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:09.783580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 809/1623] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:09 2022] PUT /identity/v3/projects/ca251d655c4843bd9138fb983ccaadd5/users/8b1c2963604a4a7ba5329b3d4a4bdacc/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:09.788318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.788605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.788874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.796241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 815/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:09.797793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:09.817706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ba27f-f99e-4672-b80c-3ffaf148f9f0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:09.880052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:09.882426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:09.976259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:09.977541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:09.978484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:09.979018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:09.980297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:09.982824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.002463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 816/1625] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:10.003980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.017310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 810/1626] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:10.018413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.020326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc361-cd1f-4208-bac4-c3e297f71899 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.031217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.033741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.034698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.035672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] PATH_INFO: `/v3/projects/3782765996b3486d9f5fadf7572594d7/users/7c98b7c3a6c346f09f6a24331d83edb8/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.041124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dcc88-4b21-4792-bfb1-4bf9943e298e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.046601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.047380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.047675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.049652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] PATH_INFO: `/v3/projects/ca251d655c4843bd9138fb983ccaadd5/users/8b1c2963604a4a7ba5329b3d4a4bdacc/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.052422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca251d655c4843bd9138fb983ccaadd5, user_id=8b1c2963604a4a7ba5329b3d4a4bdacc, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:10.058356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.065483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3782765996b3486d9f5fadf7572594d7, user_id=7c98b7c3a6c346f09f6a24331d83edb8, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:10.075768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f50f14-1a4d-4a80-b4fc-158d475b7ad0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.095039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 811/1627] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:10 2022] PUT /identity/v3/projects/ca251d655c4843bd9138fb983ccaadd5/users/8b1c2963604a4a7ba5329b3d4a4bdacc/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:10.097448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.116123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 817/1628] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:10 2022] PUT /identity/v3/projects/3782765996b3486d9f5fadf7572594d7/users/7c98b7c3a6c346f09f6a24331d83edb8/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:10.117936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.118513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.118856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.184002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] MFA Rules not processed for user `8b1c2963604a4a7ba5329b3d4a4bdacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:10.185145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:10.245119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:10.265984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c1e68-683b-457a-b29a-447c08b2b742 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.338468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:10.361421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 818/1629] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:10.361421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.529862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.531077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.531656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.532711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.585969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c85d-98ac-49b7-b236-6ba766c6902e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.602735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.603654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.603954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.604238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.605009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:10.614760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.640955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 819/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:10.647126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.795134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ab2e-1f25-4b59-aa2e-a9bdf0cb20bc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.806264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.807062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.807449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.807970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:10.833015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:10.835691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.855586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 820/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:10.858577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:10.889942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:10.896097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:10.898526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecb8e1-a8b1-4235-8126-e0cf4fb361e1 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:10.917999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:10.920974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:10.921891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:10.932767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 812/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 837 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:10.962364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] PATH_INFO: `/v3/projects/3782765996b3486d9f5fadf7572594d7/users/7c98b7c3a6c346f09f6a24331d83edb8/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:11.018785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3782765996b3486d9f5fadf7572594d7, user_id=7c98b7c3a6c346f09f6a24331d83edb8, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:11.048987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c6f06-0766-4dca-b883-c5262a8ecd59 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:11.075193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:11.091114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6292b-cfc6-48f1-b0f1-fe0d99f9ad78 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:11.102338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 821/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:10 2022] PUT /identity/v3/projects/3782765996b3486d9f5fadf7572594d7/users/7c98b7c3a6c346f09f6a24331d83edb8/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:11.112372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cef5-1d47-4d67-b741-5c4d1f38c252 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:11.112840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cef5-1d47-4d67-b741-5c4d1f38c252 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:11.113308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21cef5-1d47-4d67-b741-5c4d1f38c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:11.238568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:11.239269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:11.239553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:11.239829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:11.318859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1c21cef5-1d47-4d67-b741-5c4d1f38c252 None None] MFA Rules not processed for user `7c98b7c3a6c346f09f6a24331d83edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:11.331791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1c21cef5-1d47-4d67-b741-5c4d1f38c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:11.426464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:11.429667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:11.481678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:11.491360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 813/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:11.580287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 822/1635] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:11.610623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:11.694207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf462ee-62d8-4c5d-9948-270ead43590c service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:11.739111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:11.739763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:11.740627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:11.740903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:11.770911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:11.772655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce10a17-25b8-45ed-a0c9-13a8bdd971dd service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:11.790924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:11.800765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 814/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:13.058881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b4f7-87dc-4fbe-a2ba-7d77d7968631 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.059479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b4f7-87dc-4fbe-a2ba-7d77d7968631 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.059890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b4f7-87dc-4fbe-a2ba-7d77d7968631 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.065028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 823/1637] 10.222.0.20 () {54 vars in 965 bytes} [Wed Sep 21 10:06:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:13.083693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8efb-d062-4717-a583-4d35020ae854 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.084889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8efb-d062-4717-a583-4d35020ae854 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.085367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8efb-d062-4717-a583-4d35020ae854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.122994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-903d8efb-d062-4717-a583-4d35020ae854 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:13.124762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-903d8efb-d062-4717-a583-4d35020ae854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:13.214218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b4f7-87dc-4fbe-a2ba-7d77d7968631 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:13.262955 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 815/1638] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Sep 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:13.272865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c462bc-fb3e-4fe7-a039-8c0bb1d4c502 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.273605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c462bc-fb3e-4fe7-a039-8c0bb1d4c502 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.274069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c462bc-fb3e-4fe7-a039-8c0bb1d4c502 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.276116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 816/1639] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 21 10:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:13.284967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.285649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.286122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.348991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:13.350726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:13.397942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 817/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:13.412303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b4f7-87dc-4fbe-a2ba-7d77d7968631 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:13.418339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:13.423430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:13.424078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.424367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.424641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] PATH_INFO: `/v3/users/7ca9ead0e8344447bc376f1568b39722` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.428378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca9ead0e8344447bc376f1568b39722)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:13.430470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:13.451497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a68e2-559d-430c-a721-0f1ace964425 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:13.467481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:13.468270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.468632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.469064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.524827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:13.539905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:13.541488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca9ead0e8344447bc376f1568b39722'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:13.541963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca9ead0e8344447bc376f1568b39722'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:13.562294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca9ead0e8344447bc376f1568b39722'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:13.601952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca9ead0e8344447bc376f1568b39722'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:13.604338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ecabfbc2-58f8-4ed7-8f3b-90047457241b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca9ead0e8344447bc376f1568b39722'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:13.642363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 824/1641] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:13 2022] DELETE /identity/v3/users/7ca9ead0e8344447bc376f1568b39722 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:13.648842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04742fc-0cfe-4a9f-9c39-828f0b5c14fe None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:13.649153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04742fc-0cfe-4a9f-9c39-828f0b5c14fe None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:13.649408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04742fc-0cfe-4a9f-9c39-828f0b5c14fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:13.655853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 818/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:13.691692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c04742fc-0cfe-4a9f-9c39-828f0b5c14fe None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:13.693039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c04742fc-0cfe-4a9f-9c39-828f0b5c14fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:13.840992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:13.889141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 825/1643] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:13.930086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:14.113958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099bf3-881b-42cd-98dd-d5571b54f572 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:14.141810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836759-76d4-44e7-8887-7a28517dd674 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:14.142368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836759-76d4-44e7-8887-7a28517dd674 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:14.142368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836759-76d4-44e7-8887-7a28517dd674 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:14.148834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 826/1644] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 21 10:06:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:14.162977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:14.163781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:14.164089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:14.227233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:14.230150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:14.231294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:14.232011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:14.248973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:14.251151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:14.257746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:14.262704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:14.293973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 819/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:14.473555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 827/1646] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:14.496813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:14.511324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:14.799696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:14.895693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206d129-8bba-4907-8b84-617ffe6ec8b3 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:14.905248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:14.906922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:14.907307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:14.907592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:14.930150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:14.939033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71795e-e6e2-4c4a-ad97-ea6c573c78ff service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:14.962152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 820/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:15.151639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:15.154123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:15.232494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af113c-a293-44c1-966a-e43a55dc4610 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:15.262165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:15.265264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:15.268053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:15.268782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] PATH_INFO: `/v3/users/e6dd4fa05e994c8aaa34360fce0123cd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:15.276576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dd4fa05e994c8aaa34360fce0123cd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:15.285605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:15.496272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dd4fa05e994c8aaa34360fce0123cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:15.496272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dd4fa05e994c8aaa34360fce0123cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:15.515141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dd4fa05e994c8aaa34360fce0123cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:15.577885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dd4fa05e994c8aaa34360fce0123cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:15.580681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dd4fa05e994c8aaa34360fce0123cd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:15.623376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 828/1648] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:15 2022] DELETE /identity/v3/users/e6dd4fa05e994c8aaa34360fce0123cd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:15.628937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:15.629766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:15.629766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:15.696207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:15.715853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:15.969258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 821/1649] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:15.999546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:16.005225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:16.175850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5b5b3-4b24-4d6f-bc2b-78dcdb149427 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:16.181999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:16.182967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:16.183396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:16.183811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:16.261328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:16.262868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:16.288432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:16.297133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 829/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:16.828514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:16.831214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:16.866748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c4081-551f-4dd1-897f-598e361c4f26 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:16.890737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:16.892847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:16.893651 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:16.894617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] PATH_INFO: `/v3/projects/40c11feb98d948e8ae98c0a551260f1f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:16.901087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c11feb98d948e8ae98c0a551260f1f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:16.905769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:17.084033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c11feb98d948e8ae98c0a551260f1f', 'request_id': 'req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.096936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c11feb98d948e8ae98c0a551260f1f', 'request_id': 'req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.114586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c11feb98d948e8ae98c0a551260f1f', 'request_id': 'req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.140622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] The token cache is being invalidate because project 40c11feb98d948e8ae98c0a551260f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:17.141020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.145740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f4c08b9d-ce52-4bad-a655-5716f0ed71ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.147966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 822/1651] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:16 2022] DELETE /identity/v3/projects/40c11feb98d948e8ae98c0a551260f1f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:17.153093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:17.170624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93359d-dd33-4976-9cc8-b5fcb331c73d service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:17.346778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:17.347760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:17.348090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:17.348370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] PATH_INFO: `/v3/users/7c98b7c3a6c346f09f6a24331d83edb8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:17.351185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c98b7c3a6c346f09f6a24331d83edb8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:17.354476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:17.482855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c98b7c3a6c346f09f6a24331d83edb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.485462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c98b7c3a6c346f09f6a24331d83edb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.512759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c98b7c3a6c346f09f6a24331d83edb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.555168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c98b7c3a6c346f09f6a24331d83edb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.556803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c98b7c3a6c346f09f6a24331d83edb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:17.564250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:17.564250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:17.564641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:17.617548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 830/1652] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:17 2022] DELETE /identity/v3/users/7c98b7c3a6c346f09f6a24331d83edb8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:17.666713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] MFA Rules not processed for user `1587552a5e6d47f0af519679a08f7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:17.667985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:17.759010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:17.847641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 823/1653] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:17.925114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:17.928789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:18.282493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f66c3-0558-42b3-b993-e08d78af3d3a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:18.289920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:18.290600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:18.290881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:18.291156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:18.301915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:18.303724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324e4d-a060-49d2-b007-10af0e36590a service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:18.324279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 831/1654] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:18.671019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:18.673404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:18.906656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89bdae-a72d-4662-8a06-3f1d543cfbd7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:18.919817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:18.920977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:18.921466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:18.922044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] PATH_INFO: `/v3/projects/ef3d122c41e440859a038830d5ccaf82` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:18.930120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3d122c41e440859a038830d5ccaf82)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:18.932614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:19.052071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3d122c41e440859a038830d5ccaf82', 'request_id': 'req-c42da206-2af3-4dde-8ac8-1bc37074615a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:19.072213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3d122c41e440859a038830d5ccaf82', 'request_id': 'req-c42da206-2af3-4dde-8ac8-1bc37074615a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:19.082881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3d122c41e440859a038830d5ccaf82', 'request_id': 'req-c42da206-2af3-4dde-8ac8-1bc37074615a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:19.111350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] The token cache is being invalidate because project ef3d122c41e440859a038830d5ccaf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:19.112204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:19.114934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c42da206-2af3-4dde-8ac8-1bc37074615a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:19.119843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 824/1655] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:18 2022] DELETE /identity/v3/projects/ef3d122c41e440859a038830d5ccaf82 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:19.126796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:19.128554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:19.129050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:19.154781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:19.175950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:19.177507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:19.358340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:19.359088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:19.359634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:19.359899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 832/1656] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:19.411408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:19.419341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:19.448562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 825/1657] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:19.464927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:19.500429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab798-0fdf-4e67-bc35-2bd7ad50dfb5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:19.520476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:19.521897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:19.522381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:19.522767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:19.523603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:19.523966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:19.526045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:19.556968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 833/1658] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:19.563612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:19.588598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59217c7b-d86f-4d11-aa6d-5a7db1b42245 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:19.618619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:19.619921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:19.620406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:19.620930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:19.622052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:19.655905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:19.764226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 826/1659] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:19 2022] POST /identity/v3/projects => generated 403 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:19.764525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:19.808876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedea43-ddf4-43e5-b1a7-3381ecf1ccd7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:20.106005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:20.115912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:20.116791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:20.117765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:20.119473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:20.129241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:20.134795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:20.148155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:20.204536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53ab6b-9f4e-4293-bf53-0abcff7167f2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:20.217883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 834/1660] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:19 2022] POST /identity/v3/users => generated 302 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:20.222644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:20.248622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:20.267030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:20.271354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:20.271920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] PATH_INFO: `/v3/projects/3782765996b3486d9f5fadf7572594d7` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:20.276334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3782765996b3486d9f5fadf7572594d7)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:20.280330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ce9e-0e92-4ab7-a568-045a8449502a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:20.291953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:20.320778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:20.323510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:20.323803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:20.327257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:20.328223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:20.334613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:20.399489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 835/1661] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:20.407675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:20.465766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0da6-e3c0-4173-9c5f-326f9cf26da7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:20.515157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:20.531764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3782765996b3486d9f5fadf7572594d7', 'request_id': 'req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:20.547597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3782765996b3486d9f5fadf7572594d7', 'request_id': 'req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:20.586432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3782765996b3486d9f5fadf7572594d7', 'request_id': 'req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:20.613232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] The token cache is being invalidate because project 3782765996b3486d9f5fadf7572594d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:20.613550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:20.615723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3aa3f7fe-a7a4-4b8c-8ff0-299f6c0dd180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:20.632332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 827/1662] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:20 2022] DELETE /identity/v3/projects/3782765996b3486d9f5fadf7572594d7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:20.634541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a39e6-adb1-4b69-ae62-4a6d0a3283f3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:20.634831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a39e6-adb1-4b69-ae62-4a6d0a3283f3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:20.635108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a39e6-adb1-4b69-ae62-4a6d0a3283f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:20.677507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-996a39e6-adb1-4b69-ae62-4a6d0a3283f3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:20.678910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-996a39e6-adb1-4b69-ae62-4a6d0a3283f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:20.818283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:20.819691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:20.820216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:20.820680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:20.828914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:20.852849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:20.923307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 836/1663] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:20.925644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:20.941005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:20.997842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 828/1664] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:21.000833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.001502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.002125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.044520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88cce-6e6d-44ad-8d29-3d0e3b2dc805 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.054487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:21.057827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:21.079837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.081112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.081707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.082355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] PATH_INFO: `/v3/projects/713d12a2a49d4c239de0161153c07bae/users/13266fa3d57143c89911aee3f1bcbcfc/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.087192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 829/1665] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:21.092183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.106544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:21.112280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43762-65fd-4d00-a781-fe2b9606acdb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.128814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.129474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.132360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.132594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.133314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:21.134668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.139956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.182069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 830/1666] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:21.194818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.198063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713d12a2a49d4c239de0161153c07bae, user_id=13266fa3d57143c89911aee3f1bcbcfc, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.210305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e7e9-51cc-453f-87a1-d527a96f4852 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.210504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5ff1-24b3-455a-a664-3af785a145d6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.216099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.217107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.217531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.217960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.218897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.221115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.313994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 831/1667] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:21 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:21.315428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.352537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 837/1668] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:20 2022] PUT /identity/v3/projects/713d12a2a49d4c239de0161153c07bae/users/13266fa3d57143c89911aee3f1bcbcfc/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:21.357665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.358073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.358454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.397030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:21.399902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:21.471046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3ec5-4086-4b2e-bba6-d892631fa319 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.484089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.484895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.485498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.486381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.488793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.492084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.560233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 832/1669] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:21 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:21.561337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.585971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a85d-9e8b-405b-b2d7-a55ef016424f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.602352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.603124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.603482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.603826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.604585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.609710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.639464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 833/1670] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:21.647240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.682812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 838/1671] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:21.694450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bfa8-b2cd-42d2-8b8e-37823afa374d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.721259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.721819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.722104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.722449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.723253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.725556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.734210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:21.770021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 834/1672] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:21.772368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.802856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:21.805007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:21.806264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c540-7814-46db-a154-ad089c1d44ad None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:21.814478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:21.817548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.818054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.818572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] PATH_INFO: `/v3/projects/5453cf0189ef4d74bae12da85cf92121/users/f4f380a79bfd487e81fcb5553c9a1c2c/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.902008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5453cf0189ef4d74bae12da85cf92121, user_id=f4f380a79bfd487e81fcb5553c9a1c2c, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:21.916565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287b168-6cd7-45d3-b2a5-b53bf7507c3b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:21.967082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 839/1673] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:21 2022] PUT /identity/v3/projects/5453cf0189ef4d74bae12da85cf92121/users/f4f380a79bfd487e81fcb5553c9a1c2c/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:21.980389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:21.981827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:21.982347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:21.991464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802b27-c68c-49f5-aa77-b7d378fec2e7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:22.139749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] MFA Rules not processed for user `f4f380a79bfd487e81fcb5553c9a1c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:22.148865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:22.159569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:22.160469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:22.163141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:22.163141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:22.429736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:22.432249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:22.497833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 835/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:22.534192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 840/1675] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:22.541202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:22.603016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacb43-2527-42e9-8444-fb3adced371c service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:22.644182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:22.658211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:22.662820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:22.665782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:22.669907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:22.675817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:22.826860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 836/1676] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:22 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:22.834090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:22.928559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e6d3-806e-4079-8d26-bae8248e87a0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:23.074188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:23.107845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:23.110150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.110735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.112220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:23.113869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:23.133577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:23.194551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:23.195204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 841/1677] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:22 2022] POST /identity/v3/users => generated 297 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:23.215712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e01f0c-f40e-4d55-a7f5-ecff59d1160c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:23.228170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:23.229392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.229916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.230449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:23.231365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:23.233497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:23.274541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 837/1678] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:06:23.279768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:23.337035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f92a56-a40b-41e4-921c-4c2eca428677 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:23.350459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:23.353566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.354336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.354892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] PATH_INFO: `/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1/users/5de7e08cbe6a48f0a0581dbcda0c2883/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:23.381761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8843c0a1c0ef4f31b7a4e99c26d222d1, user_id=5de7e08cbe6a48f0a0581dbcda0c2883, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:23.396589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:23.466325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 842/1679] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:23 2022] PUT /identity/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1/users/5de7e08cbe6a48f0a0581dbcda0c2883/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:23.471065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:23.500026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b7960-688d-4c56-9cb1-a8ae6f013092 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:23.616311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:23.746068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:23.753613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.753970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.755855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:23.757064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:23.760073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cd67e-0520-4b72-8934-8ced95f5dcf6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:23.795145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:23.796989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 838/1680] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:23.838610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b705-27cb-4395-bf28-ddb6b7ef9e06 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:23.862380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:23.863960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.864093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.865362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] PATH_INFO: `/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1/users/5de7e08cbe6a48f0a0581dbcda0c2883/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:23.876640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8843c0a1c0ef4f31b7a4e99c26d222d1, user_id=5de7e08cbe6a48f0a0581dbcda0c2883, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:23.882191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:23.929906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 843/1681] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:23 2022] PUT /identity/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1/users/5de7e08cbe6a48f0a0581dbcda0c2883/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:06:23.948700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:23.951796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:23.952329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:24.025749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] MFA Rules not processed for user `5de7e08cbe6a48f0a0581dbcda0c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:24.030042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:24.256285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 839/1682] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:24.269646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:24.272252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:24.420514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:24.423424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:24.529906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e5cf-5bb1-408b-bbbf-2ebbb0ee1abd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:24.543805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:24.544760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:24.545219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:24.545667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:24.571609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:24.573711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:24.623821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 844/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:24.647913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f6a7-a7fa-4356-9035-4641abba90ca None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:24.669937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:24.683541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:24.694524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:24.694934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] PATH_INFO: `/v3/users/5b5495088ff84791bf0c63fdd21634fe` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:24.736585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5495088ff84791bf0c63fdd21634fe)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:24.748034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: WARNING py.warnings [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:24.748034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: warnings.warn(msg) Sep 21 10:06:24.748034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: Sep 21 10:06:24.749945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:24.953039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:24.968453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184af139-ba92-498c-9eb7-2eebc3472df0 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:24.971138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5495088ff84791bf0c63fdd21634fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:24.972295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5495088ff84791bf0c63fdd21634fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:24.988396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:24.989059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:24.989354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:24.989689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:25.002779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:25.006437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:25.017320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5495088ff84791bf0c63fdd21634fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:25.093297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5495088ff84791bf0c63fdd21634fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:25.094804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-83fb288a-dfda-45f2-8b7a-9f7cccd0a36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5495088ff84791bf0c63fdd21634fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:25.140358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 840/1684] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:24 2022] DELETE /identity/v3/users/5b5495088ff84791bf0c63fdd21634fe => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:25.144930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1bc34-5873-43b9-b4bc-f467cd0a24e3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:25.146352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1bc34-5873-43b9-b4bc-f467cd0a24e3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:25.146858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1bc34-5873-43b9-b4bc-f467cd0a24e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:25.227263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:25.228896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c7c1bc34-5873-43b9-b4bc-f467cd0a24e3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:25.230031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:25.231137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c7c1bc34-5873-43b9-b4bc-f467cd0a24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:25.272966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 845/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:25.509996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 841/1686] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:25.602639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:25.604694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:25.734148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:25.761940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e21b-18df-4c87-846f-4be174a64a5f service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:25.932915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:25.933640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:25.933933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:25.934272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:25.982384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:25.983945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf720ec-dbe8-4aad-9f4e-d0eeaa807ca8 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:26.004412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 846/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:26.986741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1e2b-13b9-4c69-8ebc-a6d9afa1b6ae None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:26.987435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1e2b-13b9-4c69-8ebc-a6d9afa1b6ae None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:26.987642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1e2b-13b9-4c69-8ebc-a6d9afa1b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:27.055556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4fad1e2b-13b9-4c69-8ebc-a6d9afa1b6ae None None] MFA Rules not processed for user `1587552a5e6d47f0af519679a08f7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:27.059900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4fad1e2b-13b9-4c69-8ebc-a6d9afa1b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:27.358938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 842/1688] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:27.427319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:27.427809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:27.428324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:27.515921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] MFA Rules not processed for user `680128c3fd934178b5d8d1370bb3729f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:27.521298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:27.544178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:27.544699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:27.545184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:27.629846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] MFA Rules not processed for user `13266fa3d57143c89911aee3f1bcbcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:27.631809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:27.827124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 847/1689] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:27.834020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:27.836644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:27.961150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 843/1690] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:27.966895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:27.970732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:28.048729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a183af-7b99-48ad-95af-1693871960f7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.072319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530229-7af1-41f3-a360-68e0596f7716 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.076758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.077907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.078530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.079042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.080252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.085187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.085848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.086132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.089077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.089270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.109182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:28.115242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.117324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.134893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 848/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:28.135784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.143069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:28.174638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291280-2e3a-4c86-ba57-f8fc5375be69 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.183681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.184355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.184646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.184931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] PATH_INFO: `/v3/projects/5a9e74cfd61749fca9cfdbd1f7ff11c4` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.189208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9e74cfd61749fca9cfdbd1f7ff11c4)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.191238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 844/1692] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:27 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:28.196622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.197523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: WARNING py.warnings [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 10:06:28.197523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: warnings.warn(msg) Sep 21 10:06:28.197523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: Sep 21 10:06:28.199663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.226818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:28.357686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9e74cfd61749fca9cfdbd1f7ff11c4', 'request_id': 'req-af846667-8d1c-4564-86ac-33d615baae36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.385726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9e74cfd61749fca9cfdbd1f7ff11c4', 'request_id': 'req-af846667-8d1c-4564-86ac-33d615baae36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.423013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9e74cfd61749fca9cfdbd1f7ff11c4', 'request_id': 'req-af846667-8d1c-4564-86ac-33d615baae36'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.445608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c91427-7b79-4ee7-b64c-a193fc3c14f4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.459730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] The token cache is being invalidate because project 5a9e74cfd61749fca9cfdbd1f7ff11c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:28.462777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.463768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.467619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 849/1693] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:28 2022] DELETE /identity/v3/projects/5a9e74cfd61749fca9cfdbd1f7ff11c4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:28.475284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.478499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:28.671754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.672670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.674573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.675077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.675979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.682591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.721664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846667-8d1c-4564-86ac-33d615baae36 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.735672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 845/1694] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:28 2022] POST /identity/v3/users => generated 308 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:28.738715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.744711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:28.747508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.749509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.750159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.750845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] PATH_INFO: `/v3/users/8b1c2963604a4a7ba5329b3d4a4bdacc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.757187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1c2963604a4a7ba5329b3d4a4bdacc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.764903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.768305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc0bd9-3e09-4204-bc20-1e29451224ce admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.778887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.779842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.780273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.780722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.781840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.784419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.819394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 846/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:28.820167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.840952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37843ce-5df4-4c04-b14d-0edbe6d2d1cc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:28.867167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:28.867831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:28.868204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:28.868401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] PATH_INFO: `/v3/projects/fb446720706243cd874dfc39ae80960b/users/dfe8d262058947b98d456e409565af69/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:28.885404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1c2963604a4a7ba5329b3d4a4bdacc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.886204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1c2963604a4a7ba5329b3d4a4bdacc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.902397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1c2963604a4a7ba5329b3d4a4bdacc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.907836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb446720706243cd874dfc39ae80960b, user_id=dfe8d262058947b98d456e409565af69, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:28.910870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:28.932806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1c2963604a4a7ba5329b3d4a4bdacc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.936801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1c2963604a4a7ba5329b3d4a4bdacc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:28.941964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 847/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:28 2022] PUT /identity/v3/projects/fb446720706243cd874dfc39ae80960b/users/dfe8d262058947b98d456e409565af69/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:28.948181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.954742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:28.978769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 850/1697] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:28 2022] DELETE /identity/v3/users/8b1c2963604a4a7ba5329b3d4a4bdacc => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:28.979848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:28.985501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:29.051639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:29.101218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:29.153211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b438fe-e171-4a59-97e1-e6e766b4476a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:29.244145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd5d-a5ba-420a-a897-470fc5e8717a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:29.263858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:29.264946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:29.266614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:29.266808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:29.267978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:29.271668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:29.300249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:29.300923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:29.301490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:29.301986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] PATH_INFO: `/v3/users/f4f380a79bfd487e81fcb5553c9a1c2c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:29.308586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f380a79bfd487e81fcb5553c9a1c2c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:29.311018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:29.331773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 851/1698] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:29.334960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:29.369430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c2af0-38c5-42f0-8ae6-a06102ed1cd5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:29.390754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:29.391865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:29.392410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:29.392810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] PATH_INFO: `/v3/projects/fb446720706243cd874dfc39ae80960b/users/dfe8d262058947b98d456e409565af69/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:29.407107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb446720706243cd874dfc39ae80960b, user_id=dfe8d262058947b98d456e409565af69, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:29.412353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8afec1-2fba-46d4-b8e2-2e668c1cf696 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:29.448613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f380a79bfd487e81fcb5553c9a1c2c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:29.450217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f380a79bfd487e81fcb5553c9a1c2c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:29.458057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 852/1699] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:29 2022] PUT /identity/v3/projects/fb446720706243cd874dfc39ae80960b/users/dfe8d262058947b98d456e409565af69/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:06:29.483541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f380a79bfd487e81fcb5553c9a1c2c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:29.538131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f380a79bfd487e81fcb5553c9a1c2c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:29.540357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f380a79bfd487e81fcb5553c9a1c2c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:29.581558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 848/1700] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:28 2022] DELETE /identity/v3/users/f4f380a79bfd487e81fcb5553c9a1c2c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:29.584360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4b09-027a-4c22-b347-cab8d6e3ec15 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:29.585184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4b09-027a-4c22-b347-cab8d6e3ec15 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:29.585329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4b09-027a-4c22-b347-cab8d6e3ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:29.658887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ad3a4b09-027a-4c22-b347-cab8d6e3ec15 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:29.680593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ad3a4b09-027a-4c22-b347-cab8d6e3ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:29.814591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 853/1701] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:29.910218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:29.913467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:30.104949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435a22-86e9-4e63-a6d0-ff65266ba6dd None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:30.105333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435a22-86e9-4e63-a6d0-ff65266ba6dd None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:30.105764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435a22-86e9-4e63-a6d0-ff65266ba6dd None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:30.110957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 854/1702] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 21 10:06:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:30.119927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:30.120614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:30.121111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:30.251456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6fa23-e071-47f4-af03-74c1d5f41b29 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:30.272383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:30.274696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:30.284188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:30.287669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:30.288246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:30.289027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:30.302861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 855/1703] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:30.347999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:30.351645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:30.400380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 849/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:30.409499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:30.442540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c194e2-f174-42f3-a85f-2b047f60e9a4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:30.463309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:30.465122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:30.466129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:30.467555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:30.491470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:30.499724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:30.538604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 856/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:31.832788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:31.836461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:31.899413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:32.122315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2ae6-12e4-4a25-912f-66eb58318c7d service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:32.139308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:32.139965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:32.140250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:32.140523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:32.144286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:32.189377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:32.192149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:32.210064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 850/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:33.205266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:33.208584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:33.249852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d4781-55bd-4fd8-99ed-0e59b52ebb9c service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:33.266606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:33.267653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:33.268280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:33.272514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] PATH_INFO: `/v3/projects/ca251d655c4843bd9138fb983ccaadd5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:33.275810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca251d655c4843bd9138fb983ccaadd5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:33.279685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:33.429161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca251d655c4843bd9138fb983ccaadd5', 'request_id': 'req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.438626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:33.440411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:33.448792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca251d655c4843bd9138fb983ccaadd5', 'request_id': 'req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.476237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefffd1-b1f3-4bc5-94ee-6147ff61bef7 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:33.485067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca251d655c4843bd9138fb983ccaadd5', 'request_id': 'req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.488943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:33.525115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] The token cache is being invalidate because project ca251d655c4843bd9138fb983ccaadd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:33.526084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.527548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4ea36845-5a2d-4f4c-93bf-a55eb68091aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.532997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 857/1707] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:33 2022] DELETE /identity/v3/projects/ca251d655c4843bd9138fb983ccaadd5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:33.536657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1da7-2724-4b4c-96fa-99d9f6ffaec6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:33.537260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1da7-2724-4b4c-96fa-99d9f6ffaec6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:33.537873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b1da7-2724-4b4c-96fa-99d9f6ffaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:33.570789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-328b1da7-2724-4b4c-96fa-99d9f6ffaec6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:33.573052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-328b1da7-2724-4b4c-96fa-99d9f6ffaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:33.711041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:33.711982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:33.713529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:33.714221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] PATH_INFO: `/v3/projects/5453cf0189ef4d74bae12da85cf92121` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:33.717682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5453cf0189ef4d74bae12da85cf92121)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:33.722829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:33.733229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 858/1708] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:33.744436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:33.744732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:33.745011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:33.811844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:33.833838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:33.891146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5453cf0189ef4d74bae12da85cf92121', 'request_id': 'req-23584d8d-2737-4292-a716-af35ce93862d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.916762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5453cf0189ef4d74bae12da85cf92121', 'request_id': 'req-23584d8d-2737-4292-a716-af35ce93862d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.945276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5453cf0189ef4d74bae12da85cf92121', 'request_id': 'req-23584d8d-2737-4292-a716-af35ce93862d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:33.999244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] The token cache is being invalidate because project 5453cf0189ef4d74bae12da85cf92121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:34.007954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.009381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.012371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 851/1709] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:33 2022] DELETE /identity/v3/projects/5453cf0189ef4d74bae12da85cf92121 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:34.025716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.027276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:34.074052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 859/1710] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:34.080315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.101296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5cbb2-5736-428d-8c3e-0a1cd1e1f9e0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.118206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.118901 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:34.119191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:34.119472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:34.124067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:34.124412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:34.126074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:34.131123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:34.157243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 860/1711] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:06:34.163735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.185645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78955-15ca-4291-8138-1bc06db4926d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.199027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.199778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:34.199947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:34.201044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:34.201044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:34.202917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:34.243541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23584d8d-2737-4292-a716-af35ce93862d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.283405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.284163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:34.284450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:34.284802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] PATH_INFO: `/v3/users/5de7e08cbe6a48f0a0581dbcda0c2883` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:34.303829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de7e08cbe6a48f0a0581dbcda0c2883)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:34.306723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:34.355697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 861/1712] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:34 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:34.362671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.448666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de7e08cbe6a48f0a0581dbcda0c2883'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.450362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de7e08cbe6a48f0a0581dbcda0c2883'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.459768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de7e08cbe6a48f0a0581dbcda0c2883'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.487948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de7e08cbe6a48f0a0581dbcda0c2883'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.493635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de7e08cbe6a48f0a0581dbcda0c2883'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:34.552942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 852/1713] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:34 2022] DELETE /identity/v3/users/5de7e08cbe6a48f0a0581dbcda0c2883 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:34.555113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:34.567750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8eece-1f1b-4b9e-a3cd-b63ff7441ce9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.705709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.709034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:34.709750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:34.710277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:34.711575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:34.743258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:34.790318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 862/1714] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:34 2022] POST /identity/v3/users => generated 279 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:06:34.796556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.799009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:34.838196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6d08-8459-4016-b9f0-5d32670b19cf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.853312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.854435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:34.855000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:34.855474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:34.856863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:34.869545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33ef3-3cb0-4a5b-bcb0-0c25bcbba62d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:34.916494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:34.927057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 853/1715] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:34.952414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14452c-1d6c-488a-a57e-13040c766f0c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:34.993647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:34.997086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.000289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.002112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.006880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:35.034408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:35.086907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a73b-1f48-4e79-8b5b-66d9fe065784 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.087638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a73b-1f48-4e79-8b5b-66d9fe065784 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.088064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a73b-1f48-4e79-8b5b-66d9fe065784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.144370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 863/1716] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:35.151321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:35.186932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30375454-b3c7-470d-bcfe-f586e1249bb8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:35.223445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:35.227063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.227534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.229178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] PATH_INFO: `/v3/projects/5d9c66b2b7464abc8bd7c6b0a8cb22f8/users/a7419d666c824bb58890559d9fa5c87c/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.255675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6029a73b-1f48-4e79-8b5b-66d9fe065784 None None] MFA Rules not processed for user `f0096ff6416148d4a75e70393efec73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:35.258057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6029a73b-1f48-4e79-8b5b-66d9fe065784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:35.292282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9c66b2b7464abc8bd7c6b0a8cb22f8, user_id=a7419d666c824bb58890559d9fa5c87c, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:35.302861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97df025-40e9-47c4-b18b-46dcee38e0e4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:35.341466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 864/1717] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:35 2022] PUT /identity/v3/projects/5d9c66b2b7464abc8bd7c6b0a8cb22f8/users/a7419d666c824bb58890559d9fa5c87c/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:35.343257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d06-2b31-4e77-9d7c-38610a6c2f02 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.356469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d06-2b31-4e77-9d7c-38610a6c2f02 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.360307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d06-2b31-4e77-9d7c-38610a6c2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.465342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cafc9d06-2b31-4e77-9d7c-38610a6c2f02 None None] MFA Rules not processed for user `dfe8d262058947b98d456e409565af69`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:35.473069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cafc9d06-2b31-4e77-9d7c-38610a6c2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:35.543120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 854/1718] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:35.543902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.544188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.544426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.657285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] MFA Rules not processed for user `a7419d666c824bb58890559d9fa5c87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:35.659968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:35.732481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:35.740139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 865/1719] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:35.746790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:35.749682 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:35.753414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:35.827774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] MFA Rules not processed for user `f0096ff6416148d4a75e70393efec73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:35.840300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:35.881483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 855/1720] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:35.889463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:36.069076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:36.092334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f4ee-50c4-4934-bbee-f0940e366ddd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:36.128953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:36.129615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:36.135378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:36.135703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:36.138316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:36.148270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:36.156256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 866/1721] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:36.170291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:36.175984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:36.246520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 856/1722] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:35 2022] POST /identity/v3/projects => generated 355 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:36.249741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:36.469303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7622e-67ae-41c9-b937-a461544b7345 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:36.556830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0411f6-3e5a-4938-b55e-d877a2674f48 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:36.566823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:36.568283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:36.568850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:36.569333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:36.571864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:36.576617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f2c51-d439-4e9d-9326-0b92dceebfe6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:36.691304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 857/1723] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:36 2022] POST /identity/v3/users => generated 284 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:36.696330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc250b-cf1c-4319-8136-c3141faf9fa5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:36.701652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc250b-cf1c-4319-8136-c3141faf9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:36.702846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc250b-cf1c-4319-8136-c3141faf9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:36.765375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:36.771265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:36.773662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:36.777652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:36.859282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5cdc250b-cf1c-4319-8136-c3141faf9fa5 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:36.860575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5cdc250b-cf1c-4319-8136-c3141faf9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:36.882794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:37.017115 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:37.019407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 858/1724] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:37.020948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:37.021245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:37.021530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:37.034531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:37.111741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 867/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 943 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:37.131565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:37.137507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] MFA Rules not processed for user `5a424b3a933741549c26a4ffc5ecaf93`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:37.144922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:37.196561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c394e-f872-4ca9-a6c4-935067939b4d service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:37.232620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:37.233409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:37.233551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:37.233788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:37.243474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:37.252553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:37.338653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 868/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:37.339927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:37.348896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:37.404756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7790-62bc-4352-addd-fa1069e29a15 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:37.441511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:37.442748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:37.443058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:37.443340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] PATH_INFO: `/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:37.450706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8843c0a1c0ef4f31b7a4e99c26d222d1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:37.459081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:37.494181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:37.635832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8843c0a1c0ef4f31b7a4e99c26d222d1', 'request_id': 'req-00454b1b-20b6-44b1-baef-dc6a79a48853'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:37.655199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8843c0a1c0ef4f31b7a4e99c26d222d1', 'request_id': 'req-00454b1b-20b6-44b1-baef-dc6a79a48853'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:37.675343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8843c0a1c0ef4f31b7a4e99c26d222d1', 'request_id': 'req-00454b1b-20b6-44b1-baef-dc6a79a48853'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:37.734322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 859/1727] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 706 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:37.734322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:37.739397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] The token cache is being invalidate because project 8843c0a1c0ef4f31b7a4e99c26d222d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:37.739931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:37.744755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:37.747058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 869/1728] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:37 2022] DELETE /identity/v3/projects/8843c0a1c0ef4f31b7a4e99c26d222d1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:37.751075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:37.753481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:37.776108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253dc71-ef37-4abf-81a9-b3251f35c9db None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:37.928069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:37.929210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:37.929641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:37.930060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] PATH_INFO: `/v3/projects/786897ddff294a61991cb1a839e50224/users/f298f8c4d9db4dce8ee9ba33429a6973/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:37.970560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786897ddff294a61991cb1a839e50224, user_id=f298f8c4d9db4dce8ee9ba33429a6973, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:37.975723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a06ec-1abf-4160-9262-2d2cba14a081 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:37.997055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 860/1729] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:37 2022] PUT /identity/v3/projects/786897ddff294a61991cb1a839e50224/users/f298f8c4d9db4dce8ee9ba33429a6973/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:37.998638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.001088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.001567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.030650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454b1b-20b6-44b1-baef-dc6a79a48853 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:38.052990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:38.054269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.096182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:38.203402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:38.204061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.204339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.204618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.222417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 861/1730] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:38.222417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:38.222417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.232733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.257251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdee5c-e165-44bb-aec8-002259a9a2c3 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:38.266180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:38.267099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.267395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.268312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.268543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:38.284156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:38.311443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 862/1731] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:38.317612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:38.319421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:38.323952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.469156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:38.472922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91ecf-e26c-477c-8aa6-10be5ecac69f service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:38.495726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca352-f5d8-40f0-a5bd-36d223a35ab5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:38.517096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 870/1732] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:06:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:06:38.517763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:38.518442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.518725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.519007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.519373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.521991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.522960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.525324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.599710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:38.611319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:38.648742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 871/1733] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:38.655884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:38.695782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564986d-88f2-401c-bc6f-3b11622bb4fa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:38.716861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:38.719085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.719388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.721429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] PATH_INFO: `/v3/projects/786897ddff294a61991cb1a839e50224/users/f298f8c4d9db4dce8ee9ba33429a6973/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.726885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=786897ddff294a61991cb1a839e50224, user_id=f298f8c4d9db4dce8ee9ba33429a6973, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:38.731586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:38.782277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 872/1734] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:38 2022] PUT /identity/v3/projects/786897ddff294a61991cb1a839e50224/users/f298f8c4d9db4dce8ee9ba33429a6973/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:38.782277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:38.784434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:38.788073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea219-f131-4fd9-ac89-4b7a46a6ac45 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:38.846151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 863/1735] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:38.848950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd489-0c86-4ca8-b8ef-8adebc7b6869 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.849448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd489-0c86-4ca8-b8ef-8adebc7b6869 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.849953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd489-0c86-4ca8-b8ef-8adebc7b6869 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:38.875857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 864/1736] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:06:38 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:38.878327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684197f-f70c-4e33-8941-c7c69dc6fb34 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:38.879017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684197f-f70c-4e33-8941-c7c69dc6fb34 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:38.880183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684197f-f70c-4e33-8941-c7c69dc6fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:39.067622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608408c-b2f9-4a6a-aeab-6fcea0162b1d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:39.089816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:39.090500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5684197f-f70c-4e33-8941-c7c69dc6fb34 None None] MFA Rules not processed for user `f298f8c4d9db4dce8ee9ba33429a6973`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:39.091339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:39.092860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:39.093991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:39.095733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:39.096992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:39.099403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5684197f-f70c-4e33-8941-c7c69dc6fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:39.102320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be0c1-8f2b-4463-95ca-836d90498081 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:39.157339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 873/1737] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:39.159809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:39.161113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:39.161642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:39.235326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:39.244720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:39.292023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:39.421106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 865/1738] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:39.421106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:39.421106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:39.421106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:39.523391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] MFA Rules not processed for user `b3493c19a0c5463cb536583401c7d22e`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:39.524700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:39.711753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 874/1739] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:39.714077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:39.731264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 866/1740] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:39.741042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:39.745901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:39.793979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da14f7b-1d13-4def-b044-5a5f65e7ac90 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:39.814949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:39.821837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:39.821837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:39.821837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:39.822562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:39.826985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e43d5-f915-4e3d-9b2c-f57f6df54e3a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:39.977393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 875/1741] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:39 2022] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:39.977856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:39.978159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:39.978461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:40.060983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c713f5e-5dc5-44d5-b8bf-74dd9c0976bf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:40.066022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] MFA Rules not processed for user `b3493c19a0c5463cb536583401c7d22e`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:40.071791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:40.093870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:40.219635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:40.220211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:40.220821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:40.221099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:40.330841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 876/1742] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:40.336623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:40.371660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:40.544120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:40.546482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:40.566403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 867/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:40.567445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:40.570587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:40.684575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1131-a0de-472b-9cd9-17d61d49edfa None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:40.720935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:40.726099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:40.728883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:40.731470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:40.735969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:40.738562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:40.806427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 877/1744] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:40 2022] POST /identity/v3/users => generated 288 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:40.819052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:40.861135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37164736-ed86-401c-b73b-5d314948ffde service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:40.889517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:40.889517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:40.889517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:40.889517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:40.909542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:40.910629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:40.958125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 868/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:40.960304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:40.993565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7699da-a712-4589-ac88-db93cfa70685 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:40.997589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:40.998314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:40.998603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:40.998880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.000928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:41.196852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:41.199240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:41.219553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1086-2e24-4689-86db-044da0e94d7b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:41.224361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 869/1746] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:41.225718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:41.253669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:41.257012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b118e-f4ad-4a57-af8c-6713fffccb61 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:41.258151 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:41.258799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:41.259870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.271535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:41.272276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:41.272570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:41.272852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.273600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:41.283794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:41.301062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:41.315516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 870/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:41.317561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:41.318444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a56fe5-4559-44be-ae15-f8ab58a5e4a9 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:41.334493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b19ef-c806-4d59-977b-e74b2902468b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:41.351307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:41.352801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:41.352801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:41.352801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.353292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:41.354838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:41.380094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 871/1748] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:06:41.385913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 878/1749] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:41.387065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:41.417206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483ebc8-e615-4296-a979-022e437aa3ba admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:41.436687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:41.437696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:41.444302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:41.444841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] PATH_INFO: `/v3/projects/c7258a067492434bab1f725f48766982/users/f8e85286c14f4610b98cf0e25cdb9fc6/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.510818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7258a067492434bab1f725f48766982, user_id=f8e85286c14f4610b98cf0e25cdb9fc6, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:41.513625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:41.549905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 872/1750] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:41 2022] PUT /identity/v3/projects/c7258a067492434bab1f725f48766982/users/f8e85286c14f4610b98cf0e25cdb9fc6/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:41.582918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce327-fd03-4f1e-932c-92635e2fb54f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:41.583282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce327-fd03-4f1e-932c-92635e2fb54f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:41.583476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce327-fd03-4f1e-932c-92635e2fb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:41.765893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cf0ce327-fd03-4f1e-932c-92635e2fb54f None None] MFA Rules not processed for user `f8e85286c14f4610b98cf0e25cdb9fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:41.771912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cf0ce327-fd03-4f1e-932c-92635e2fb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:41.837534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:42.027544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 879/1751] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:42.029305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:42.031534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:42.061333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:42.353522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab386-73ab-4677-85f2-9900bdfafbf2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:42.376047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:42.376739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:42.376959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:42.377282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:42.407632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:42.409263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:42.453857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 873/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:43.486048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b023-df59-4abd-a927-e4adae841953 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:43.486913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b023-df59-4abd-a927-e4adae841953 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:43.487184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621b023-df59-4abd-a927-e4adae841953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:43.620215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3621b023-df59-4abd-a927-e4adae841953 None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:43.627168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3621b023-df59-4abd-a927-e4adae841953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:43.872555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 880/1753] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Sep 21 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:44.464754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:44.469233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:44.493420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b69c09-d34c-4878-9e53-39b18cee1699 service glance] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:44.502977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:44.506172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:44.507608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:44.508062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:44.540326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:44.542737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97deebba-bb50-4191-835c-e5d548c07fd9 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:44.569813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 874/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:45.154927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:45.155426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:45.155646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:45.240932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3bf60-74e9-49dc-af5f-dc07e4737fbd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:45.241818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3bf60-74e9-49dc-af5f-dc07e4737fbd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:45.242583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3bf60-74e9-49dc-af5f-dc07e4737fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:45.245988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] MFA Rules not processed for user `680128c3fd934178b5d8d1370bb3729f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:45.259355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:45.334803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-82b3bf60-74e9-49dc-af5f-dc07e4737fbd None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:45.345129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-82b3bf60-74e9-49dc-af5f-dc07e4737fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:45.548117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 881/1755] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:45.575427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 875/1756] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:45.592034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:45.958742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454936-c185-4308-b5a5-5c95a3fbd826 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:46.017961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:46.021231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:46.022172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:46.024251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:46.063858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:46.074093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ee887-3353-4fbc-9e4a-e076450bf895 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:46.116005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 882/1757] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:06:46.346524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001ae2-4a4c-4502-ba4e-e149f303ebd7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:46.347078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001ae2-4a4c-4502-ba4e-e149f303ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:46.347574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001ae2-4a4c-4502-ba4e-e149f303ebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:46.418657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-71001ae2-4a4c-4502-ba4e-e149f303ebd7 None None] MFA Rules not processed for user `5a424b3a933741549c26a4ffc5ecaf93`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:46.420976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-71001ae2-4a4c-4502-ba4e-e149f303ebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:46.624448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 876/1758] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:46.788785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b382-ff9e-469c-a7ca-22313c97128b None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:46.789672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b382-ff9e-469c-a7ca-22313c97128b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:46.789672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b382-ff9e-469c-a7ca-22313c97128b None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:46.791085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 883/1759] 10.222.0.20 () {54 vars in 912 bytes} [Wed Sep 21 10:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 10:06:46.813404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:46.813882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:46.814117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:46.884020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:46.888065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:46.909486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 877/1760] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:47.021325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6a2b-d694-419e-aeb7-a4f1a3286628 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:47.021774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6a2b-d694-419e-aeb7-a4f1a3286628 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:47.022063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6a2b-d694-419e-aeb7-a4f1a3286628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:47.035036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:47.073600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-27ff6a2b-d694-419e-aeb7-a4f1a3286628 None None] MFA Rules not processed for user `f0096ff6416148d4a75e70393efec73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:47.077267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-27ff6a2b-d694-419e-aeb7-a4f1a3286628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:47.093840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:47.127804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f0d4-cf48-4dbb-8990-2b2b2fa431f7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:47.153091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:47.156587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:47.157667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:47.158182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:47.178922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:47.180900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a85741-a583-4e74-a9e6-0d669080da01 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:47.213598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 878/1761] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:06:47.228906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006491-1fb4-43bb-9894-55826fe441a4 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:47.229947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006491-1fb4-43bb-9894-55826fe441a4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:47.230535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006491-1fb4-43bb-9894-55826fe441a4 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:47.232419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 879/1762] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:47.252521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 884/1763] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:47.295217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e56c-0a41-4530-9d8b-978e2345e663 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:47.295523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e56c-0a41-4530-9d8b-978e2345e663 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:47.295818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e56c-0a41-4530-9d8b-978e2345e663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:47.348720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7f91e56c-0a41-4530-9d8b-978e2345e663 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:47.350712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7f91e56c-0a41-4530-9d8b-978e2345e663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:47.371799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:47.530498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 880/1764] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:48.001995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fab5-92d4-4802-8cdf-aa0054827167 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:48.003469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fab5-92d4-4802-8cdf-aa0054827167 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:48.004714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757fab5-92d4-4802-8cdf-aa0054827167 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:48.009344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 885/1765] 10.222.0.20 () {54 vars in 961 bytes} [Wed Sep 21 10:06:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:48.023299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:48.024512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:48.024512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:48.102725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] MFA Rules not processed for user `d16e15230c59475eba52906ad0643fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:48.104093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:48.141236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757fab5-92d4-4802-8cdf-aa0054827167 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:48.148507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 881/1766] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Sep 21 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:48.152845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:48.158885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:48.177505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757fab5-92d4-4802-8cdf-aa0054827167 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:48.188048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:48.189444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:48.190103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:48.190874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:48.224081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:48.231078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:48.329140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 886/1767] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:06:48.449505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c0f48-9c68-4d61-92cd-cde0b2173762 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:48.464606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:48.465842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:48.466511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:48.466807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] PATH_INFO: `/v3/users/13266fa3d57143c89911aee3f1bcbcfc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:48.468971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13266fa3d57143c89911aee3f1bcbcfc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:48.482830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:48.652754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13266fa3d57143c89911aee3f1bcbcfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:48.659891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13266fa3d57143c89911aee3f1bcbcfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:48.699751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13266fa3d57143c89911aee3f1bcbcfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:48.819805 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13266fa3d57143c89911aee3f1bcbcfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:48.821013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13266fa3d57143c89911aee3f1bcbcfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:48.898754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 882/1768] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:48 2022] DELETE /identity/v3/users/13266fa3d57143c89911aee3f1bcbcfc => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:06:50.634004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:50.716522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf691d1-13b7-4984-8309-0b9ef0cf6671 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:51.187671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:51.190671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:51.194706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:51.195344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] PATH_INFO: `/v3/projects/713d12a2a49d4c239de0161153c07bae` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:51.197064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713d12a2a49d4c239de0161153c07bae)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:51.203290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:51.483505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713d12a2a49d4c239de0161153c07bae', 'request_id': 'req-5c460067-5ef5-445b-94d4-4fc548245055'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:51.514313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713d12a2a49d4c239de0161153c07bae', 'request_id': 'req-5c460067-5ef5-445b-94d4-4fc548245055'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:51.539266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713d12a2a49d4c239de0161153c07bae', 'request_id': 'req-5c460067-5ef5-445b-94d4-4fc548245055'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:51.576742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] The token cache is being invalidate because project 713d12a2a49d4c239de0161153c07bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:51.577081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:51.578389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5c460067-5ef5-445b-94d4-4fc548245055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:51.585058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 887/1769] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:50 2022] DELETE /identity/v3/projects/713d12a2a49d4c239de0161153c07bae => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:51.591750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:51.597398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:51.681808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1cf2-a8d7-471f-9a2e-e98d696ec382 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:51.684629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1cf2-a8d7-471f-9a2e-e98d696ec382 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:51.685507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1cf2-a8d7-471f-9a2e-e98d696ec382 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:51.687223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864037c1-43e2-44a3-abf0-1f2faa84e111 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:51.689795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 888/1770] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:06:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:51.751131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916cdc-f37b-4509-95a7-e17714263779 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:51.752296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916cdc-f37b-4509-95a7-e17714263779 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:51.752889 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916cdc-f37b-4509-95a7-e17714263779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:51.803033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:51.931082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-65916cdc-f37b-4509-95a7-e17714263779 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:51.935916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-65916cdc-f37b-4509-95a7-e17714263779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:52.008246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:52.009121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:52.009504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:52.009897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] PATH_INFO: `/v3/users/dfe8d262058947b98d456e409565af69` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:52.014485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe8d262058947b98d456e409565af69)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:52.021468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:52.122704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:52.240858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe8d262058947b98d456e409565af69'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:52.241886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe8d262058947b98d456e409565af69'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:52.262735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe8d262058947b98d456e409565af69'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:52.381126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe8d262058947b98d456e409565af69'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:52.382636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe8d262058947b98d456e409565af69'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:52.541842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 883/1771] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:06:51 2022] DELETE /identity/v3/users/dfe8d262058947b98d456e409565af69 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:52.606091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 889/1772] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:06:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 857 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:53.306154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:53.312420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:53.645885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650398d3-2140-47a3-a06d-3f2193908f10 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:53.670870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:53.671635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:53.671975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:53.672240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] PATH_INFO: `/v3/projects/fb446720706243cd874dfc39ae80960b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:53.679271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb446720706243cd874dfc39ae80960b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:53.683991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:53.867669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:53.897833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb446720706243cd874dfc39ae80960b', 'request_id': 'req-e642d387-a5c4-47f4-9d3d-3f23a0137b82'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:53.939170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb446720706243cd874dfc39ae80960b', 'request_id': 'req-e642d387-a5c4-47f4-9d3d-3f23a0137b82'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:53.974797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb446720706243cd874dfc39ae80960b', 'request_id': 'req-e642d387-a5c4-47f4-9d3d-3f23a0137b82'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:54.027880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] The token cache is being invalidate because project fb446720706243cd874dfc39ae80960b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:06:54.028775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:54.029887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e642d387-a5c4-47f4-9d3d-3f23a0137b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:06:54.036793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 884/1773] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:06:53 2022] DELETE /identity/v3/projects/fb446720706243cd874dfc39ae80960b => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:54.044580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:54.045117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:54.045522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:54.227556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:54.249582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:54.507152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:54.508006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:54.508006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:54.510728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 890/1774] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:54.571179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:54.573639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:54.623754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 885/1775] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:54.627351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:54.648142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b1cd-1fec-4963-b0cf-66320bbcce13 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:54.665747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:54.666659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:54.666949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:54.667230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:54.669576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:06:54.669576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:54.670029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:54.708185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:54.715766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 891/1776] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:06:54.731042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f6265-996c-42c1-9c7d-1318e06f9cb2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:54.772525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:54.773301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:54.773645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:54.774801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:54.778071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:54.780315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:54.910714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:54.921037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 886/1777] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:54 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:54.951134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2a99-5bf2-4193-b793-9d0c66bd27af admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:55.315866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:55.319867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:55.321228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:55.323466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:55.325523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:55.331959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:55.422155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 892/1778] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:54 2022] POST /identity/v3/users => generated 285 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:55.427024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:55.456255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e6fc-d227-4a19-991e-aac4b693cfc8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:55.472193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:55.472881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:55.473200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:55.473480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:55.474163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:55.476063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:55.505238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:55.505677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 887/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:55.531994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255e7f-3da6-4b69-8680-bb681a5205b6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:55.552738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:55.553454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:55.553748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:55.554024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:55.554945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:55.556796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39800f-d780-49bc-8914-da726cbbf2f4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:55.598823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:55.612840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 893/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:55.616404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79750-5cec-44fc-9c43-b0aa34bfcd0d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:55.627778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:55.628807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:55.631192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:55.631747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] PATH_INFO: `/v3/projects/00744ec6822d465e820a3c8df84fc729/users/a2367f92bb22451e962be9a27a9fa176/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:55.682881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00744ec6822d465e820a3c8df84fc729, user_id=a2367f92bb22451e962be9a27a9fa176, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:55.686156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:55.736821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df32b-8d13-4118-9b00-d646ecd974a3 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:55.737424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df32b-8d13-4118-9b00-d646ecd974a3 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:55.737847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df32b-8d13-4118-9b00-d646ecd974a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:55.742200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 888/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:55 2022] PUT /identity/v3/projects/00744ec6822d465e820a3c8df84fc729/users/a2367f92bb22451e962be9a27a9fa176/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:55.799804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-772df32b-8d13-4118-9b00-d646ecd974a3 None None] MFA Rules not processed for user `a2367f92bb22451e962be9a27a9fa176`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:55.801901 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-772df32b-8d13-4118-9b00-d646ecd974a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:55.837870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:56.051379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:56.061584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 894/1782] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:56.186877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f16cb2-5b4c-4b75-861c-1aa04ebbd28f None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:56.188908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f16cb2-5b4c-4b75-861c-1aa04ebbd28f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:56.190110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f16cb2-5b4c-4b75-861c-1aa04ebbd28f None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:56.198928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 895/1783] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:06:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:06:56.323792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc3f3-5c07-4c52-b1f1-4e1d0078aaa0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:56.337774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:56.338569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:56.339104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:56.339460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:56.340215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:56.343596 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a789860-35e3-476c-a8a1-3fe40147a63d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:56.437096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f16cb2-5b4c-4b75-861c-1aa04ebbd28f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:56.437946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 889/1784] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:06:56 2022] POST /identity/v3/projects => generated 363 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:06:56.464827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:56.464827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:56.465240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:56.521823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:56.524819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:56.684077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f16cb2-5b4c-4b75-861c-1aa04ebbd28f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:56.697500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:56.698152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:56.698534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:56.703136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:56.705839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:56.708394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:06:56.714648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:56.794223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 890/1785] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:06:56.843686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 896/1786] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:06:56 2022] POST /identity/v3/users => generated 288 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:06:56.846062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:56.892609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad62b6-1e93-4791-9b6a-440f636a0d57 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:56.917369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:56.918615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:56.919214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:56.919703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:56.925561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:56.935178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:56.991052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 891/1787] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:56.995209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:57.020013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b976-6daf-4ef4-ba39-8bd1a559de2a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:57.063632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:57.063632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:57.063632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:57.063632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] PATH_INFO: `/v3/projects/5541129ae0bc41ff9eb436cb79c633b6/users/776f0c5c42d04ba8a721825cea5c8e32/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:57.136471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5541129ae0bc41ff9eb436cb79c633b6, user_id=776f0c5c42d04ba8a721825cea5c8e32, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:57.145573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:57.214138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 897/1788] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:56 2022] PUT /identity/v3/projects/5541129ae0bc41ff9eb436cb79c633b6/users/776f0c5c42d04ba8a721825cea5c8e32/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:06:57.216066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:57.274004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183144c-550d-4dec-a126-ae639fdbf8f5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:57.505440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:57.507073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:57.507592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:57.508357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:57.511096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:57.515391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dbee7-8087-46f7-a3e1-b5bf3909c2da admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:57.557973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 892/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:06:57.562087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:57.591590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21c47-426c-4cfa-96ba-4dbdc086802c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:57.610478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:57.611702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:57.611997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:57.612273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] PATH_INFO: `/v3/projects/5541129ae0bc41ff9eb436cb79c633b6/users/776f0c5c42d04ba8a721825cea5c8e32/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:57.615353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5541129ae0bc41ff9eb436cb79c633b6, user_id=776f0c5c42d04ba8a721825cea5c8e32, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:57.620704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:57.641571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 898/1790] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:06:57 2022] PUT /identity/v3/projects/5541129ae0bc41ff9eb436cb79c633b6/users/776f0c5c42d04ba8a721825cea5c8e32/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:06:57.649669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:57.649669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:57.650190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:57.699198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] MFA Rules not processed for user `776f0c5c42d04ba8a721825cea5c8e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:06:57.700780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:57.853080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 893/1791] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:06:57.869222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:06:57.873722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:06:57.986729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e3f0-1199-438e-a92f-cfe9a67bf09d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:06:57.995495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:06:57.996849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:06:57.997345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:06:57.997840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:06:58.040146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:06:58.045814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:06:58.071893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 899/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:00.646606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:00.648973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:00.759483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:00.789564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140019-067f-4a47-bcc4-6f314cff8b13 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:00.798435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:00.799638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:00.800042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:00.800429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:00.803095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:00.822137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:00.824510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:00.841408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 894/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:00.963026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:00.989089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb298c-6fe8-40fd-95ad-877aedf130d7 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:01.046613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:01.050085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:01.050174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:01.050542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:01.062709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:01.069376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:01.071350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf5dd-29da-4812-aeb7-14c1e61730ef service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:01.106362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 900/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:01.155157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:01.265106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc289-6bbe-42e4-a768-0d505a233068 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:01.274883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:01.276308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:01.276783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:01.278366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] PATH_INFO: `/v3/users/a2367f92bb22451e962be9a27a9fa176` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:01.281902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2367f92bb22451e962be9a27a9fa176)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:01.297456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:01.449185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2367f92bb22451e962be9a27a9fa176'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:01.449926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2367f92bb22451e962be9a27a9fa176'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:01.458824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2367f92bb22451e962be9a27a9fa176'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:01.476627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2367f92bb22451e962be9a27a9fa176'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:01.478061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2367f92bb22451e962be9a27a9fa176'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:01.497503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 895/1795] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:01 2022] DELETE /identity/v3/users/a2367f92bb22451e962be9a27a9fa176 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:01.503144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:01.504388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:01.505049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:01.557055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:01.559354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:01.710435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 901/1796] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:01.720618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:01.723370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:01.817361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc174b-58ed-40f8-b25d-9bbf5bdfdf1a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:01.823400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:01.824076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:01.824474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:01.824829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:01.842912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:01.845445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:01.854030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:01.861374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 896/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:02.222970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:02.230508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:02.258333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb5977-f950-4cba-850d-a8520a81760e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:02.273184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:02.274269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:02.274820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:02.275633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] PATH_INFO: `/v3/projects/00744ec6822d465e820a3c8df84fc729` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:02.278162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00744ec6822d465e820a3c8df84fc729)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:02.281958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:02.381969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00744ec6822d465e820a3c8df84fc729', 'request_id': 'req-d6d32543-4036-4f91-a9ae-f2c905aaac64'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.433443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00744ec6822d465e820a3c8df84fc729', 'request_id': 'req-d6d32543-4036-4f91-a9ae-f2c905aaac64'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.460716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00744ec6822d465e820a3c8df84fc729', 'request_id': 'req-d6d32543-4036-4f91-a9ae-f2c905aaac64'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.521992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] The token cache is being invalidate because project 00744ec6822d465e820a3c8df84fc729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:02.522689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.523776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.531660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 902/1798] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:02 2022] DELETE /identity/v3/projects/00744ec6822d465e820a3c8df84fc729 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:02.533004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:02.562707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed9da-2d27-449c-94ad-b3c5f11fb29c service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:02.696887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:02.697549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:02.697895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:02.698181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] PATH_INFO: `/v3/users/776f0c5c42d04ba8a721825cea5c8e32` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:02.699522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=776f0c5c42d04ba8a721825cea5c8e32)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:02.701800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:02.808583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776f0c5c42d04ba8a721825cea5c8e32'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.809729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776f0c5c42d04ba8a721825cea5c8e32'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.822398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776f0c5c42d04ba8a721825cea5c8e32'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.838353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776f0c5c42d04ba8a721825cea5c8e32'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.840314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9e8582da-ba50-4785-9adc-9edb57aff76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776f0c5c42d04ba8a721825cea5c8e32'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:02.867568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 897/1799] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:02 2022] DELETE /identity/v3/users/776f0c5c42d04ba8a721825cea5c8e32 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:03.207923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:03.214128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:03.235075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d32543-4036-4f91-a9ae-f2c905aaac64 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:03.342626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:03.343617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.344095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.344610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] PATH_INFO: `/v3/projects/5541129ae0bc41ff9eb436cb79c633b6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.345886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5541129ae0bc41ff9eb436cb79c633b6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:03.348627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:03.378061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:03.438084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5541129ae0bc41ff9eb436cb79c633b6', 'request_id': 'req-472d1e51-2317-475c-9ce5-1fa803a85ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:03.455739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5541129ae0bc41ff9eb436cb79c633b6', 'request_id': 'req-472d1e51-2317-475c-9ce5-1fa803a85ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:03.464168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5541129ae0bc41ff9eb436cb79c633b6', 'request_id': 'req-472d1e51-2317-475c-9ce5-1fa803a85ad5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:03.477378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] The token cache is being invalidate because project 5541129ae0bc41ff9eb436cb79c633b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:03.477668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:03.478375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-472d1e51-2317-475c-9ce5-1fa803a85ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:03.479931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 903/1800] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:03 2022] DELETE /identity/v3/projects/5541129ae0bc41ff9eb436cb79c633b6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:03.488015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.488535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.488854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.516031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:03.517638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:03.596816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 898/1801] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:03.605940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.606534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.606534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.626606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:03.627840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:03.641064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 904/1802] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:03.649069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:03.663189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4353a-4311-4af7-a6d2-112cde7741bb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:03.674382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:03.674382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.674382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.674382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.674897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:03.675104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:03.677067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:03.698128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 899/1803] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:03.699147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:03.715832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9ad6f-be2f-4a26-84c0-951746ce858e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:03.726472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:03.727220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.727355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.727610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.728270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:03.734965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:03.783215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 905/1804] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:03 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:03.787389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:03.802530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa86b2-c65a-4217-9fc3-d4c3279734c2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:03.809137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:03.920569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:03.921199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.921480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.921762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.922468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:03.924410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:03.953679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 900/1805] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:03 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:03.958755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:03.970847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161e49-9e31-41dd-8ee5-25a3997f63cc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:03.976599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:03.977412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:03.980850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:03.980850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:03.980850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:03.980850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:03.992673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 906/1806] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:03.997214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.008347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa57be-abdc-4943-a650-548c9500cd84 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.014141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.014905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.015197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.015553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.016212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.018095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73b83-eafb-41ba-a245-53b8a7ab5448 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.032033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 901/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:04.036433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.047564 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680804-2749-49fd-827c-67fd368b0772 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.053700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.054409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.054747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.055037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] PATH_INFO: `/v3/projects/629230e617a140ff9b17b2fa832b691c/users/e905e9144e57404e995fa5f85a3d0aeb/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.072265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629230e617a140ff9b17b2fa832b691c, user_id=e905e9144e57404e995fa5f85a3d0aeb, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.075476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.094874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 907/1808] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:04 2022] PUT /identity/v3/projects/629230e617a140ff9b17b2fa832b691c/users/e905e9144e57404e995fa5f85a3d0aeb/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:04.107022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.107264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.108523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.144477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] MFA Rules not processed for user `e905e9144e57404e995fa5f85a3d0aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:04.146054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:04.254183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 902/1809] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:04.258833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.345362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4e859-c523-4cb7-ad57-de3c3df7cfb7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.353661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.354808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.355313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.355871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.356671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.360882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.401748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 908/1810] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:04 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:04.406002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.417426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d9fe6-6bc2-4a8e-a9ca-4d03d3221b53 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.494971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.495493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.495996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.496144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.496804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.499019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.535995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 903/1811] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:04 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:04.539328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.552704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0a84e-6527-4e68-b952-429616a1ee22 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.558821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.559512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.559755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.560029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.560716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.562408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.586579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 909/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:04.591344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.598682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:04.603037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c337f1-7d38-4a42-8a25-a2757f6bbe7e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.609040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.609649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.609929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.610203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] PATH_INFO: `/v3/projects/c97888a9b36e4341bfc0efc9215aefc6/users/79a9ed4604a74377935e5a2c54589a5a/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.627378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97888a9b36e4341bfc0efc9215aefc6, user_id=79a9ed4604a74377935e5a2c54589a5a, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.630112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.645361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 904/1813] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:04 2022] PUT /identity/v3/projects/c97888a9b36e4341bfc0efc9215aefc6/users/79a9ed4604a74377935e5a2c54589a5a/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:04.649936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.661536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9a3fd-b676-48b8-a998-f8cbc79f247d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.675547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:04.739265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.740040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.740364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.740679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.741732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.744473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c35f57-359b-40ba-af96-1172b2546f52 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.760057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 910/1814] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:04.764688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:04.776543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578088-e693-41ee-a70a-64613022680f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:04.781681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:04.782440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.782747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.783047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] PATH_INFO: `/v3/projects/c97888a9b36e4341bfc0efc9215aefc6/users/79a9ed4604a74377935e5a2c54589a5a/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.785733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97888a9b36e4341bfc0efc9215aefc6, user_id=79a9ed4604a74377935e5a2c54589a5a, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:04.788715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:04.801781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 905/1815] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:04 2022] PUT /identity/v3/projects/c97888a9b36e4341bfc0efc9215aefc6/users/79a9ed4604a74377935e5a2c54589a5a/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:04.812546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18729897-341b-48da-9058-4f60f695cc2d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:04.812867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18729897-341b-48da-9058-4f60f695cc2d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:04.813165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18729897-341b-48da-9058-4f60f695cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:04.861381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-18729897-341b-48da-9058-4f60f695cc2d None None] MFA Rules not processed for user `79a9ed4604a74377935e5a2c54589a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:04.863083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-18729897-341b-48da-9058-4f60f695cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:05.015159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 911/1816] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:05.030157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:05.032152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:05.173254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4aac-b808-448d-bdf7-029ea4951b6b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:05.177920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:05.181661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:05.181999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:05.182788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:05.194128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:05.195757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:05.207774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 906/1817] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:05.324324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18729897-341b-48da-9058-4f60f695cc2d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:05.364194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18729897-341b-48da-9058-4f60f695cc2d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:05.385518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:05.387021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:05.396608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:05.397361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:05.397643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:05.397913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:05.537329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:05.539478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d8411-c091-43d7-8e74-788b50f96b8b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:05.539770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf2f0-efeb-44c4-a710-ad6e181da007 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:05.546182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:05.547132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:05.547523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:05.547934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] PATH_INFO: `/v3/users/a7419d666c824bb58890559d9fa5c87c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:05.549310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7419d666c824bb58890559d9fa5c87c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:05.552843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:05.553057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 912/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:05.643816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7419d666c824bb58890559d9fa5c87c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:05.644817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7419d666c824bb58890559d9fa5c87c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:05.655852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7419d666c824bb58890559d9fa5c87c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:05.673914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:05.677268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7419d666c824bb58890559d9fa5c87c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:05.680432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7419d666c824bb58890559d9fa5c87c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:05.706767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 907/1819] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:05 2022] DELETE /identity/v3/users/a7419d666c824bb58890559d9fa5c87c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:05.711869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:05.712755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:05.713141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:05.752589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:05.755068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:05.835812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:05.883357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 913/1820] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:05.894935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:05.896685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:06.006823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78eb1-b317-4960-bee1-ba65fe4078b6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:06.015871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:06.017524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:06.018490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:06.019576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:06.039490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:06.042146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:06.058193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 908/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:06.513078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:06.514973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:06.529618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df90f4-5ee9-47de-bd5a-8e78e38f77b0 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:06.536536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:06.537859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:06.538280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:06.538655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] PATH_INFO: `/v3/projects/5d9c66b2b7464abc8bd7c6b0a8cb22f8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:06.540403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9c66b2b7464abc8bd7c6b0a8cb22f8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:06.542745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:06.601179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9c66b2b7464abc8bd7c6b0a8cb22f8', 'request_id': 'req-a04880b1-571e-4bce-bded-bb1bf2726bef'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.610211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9c66b2b7464abc8bd7c6b0a8cb22f8', 'request_id': 'req-a04880b1-571e-4bce-bded-bb1bf2726bef'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.617063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9c66b2b7464abc8bd7c6b0a8cb22f8', 'request_id': 'req-a04880b1-571e-4bce-bded-bb1bf2726bef'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.628064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] The token cache is being invalidate because project 5d9c66b2b7464abc8bd7c6b0a8cb22f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:06.628337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.629530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.631067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 914/1822] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:06 2022] DELETE /identity/v3/projects/5d9c66b2b7464abc8bd7c6b0a8cb22f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:06.635374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:06.646859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ac2af-0b9f-458e-80f8-9c83956623f1 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:06.724287 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:06.725202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:06.725653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:06.726092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] PATH_INFO: `/v3/users/f298f8c4d9db4dce8ee9ba33429a6973` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:06.728072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f298f8c4d9db4dce8ee9ba33429a6973)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:06.731420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:06.798387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f298f8c4d9db4dce8ee9ba33429a6973'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.799086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f298f8c4d9db4dce8ee9ba33429a6973'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.811609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f298f8c4d9db4dce8ee9ba33429a6973'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.842367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f298f8c4d9db4dce8ee9ba33429a6973'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.843951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-237e55db-3c36-456a-a4ca-67406a7bb2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f298f8c4d9db4dce8ee9ba33429a6973'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:06.865600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 909/1823] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:06 2022] DELETE /identity/v3/users/f298f8c4d9db4dce8ee9ba33429a6973 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:07.375373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:07.378381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:07.429609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04880b1-571e-4bce-bded-bb1bf2726bef admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:07.604224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:07.605047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:07.605696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:07.605978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] PATH_INFO: `/v3/projects/786897ddff294a61991cb1a839e50224` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:07.610528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786897ddff294a61991cb1a839e50224)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:07.612514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:07.671239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786897ddff294a61991cb1a839e50224', 'request_id': 'req-793276b6-021c-4309-bfc6-68a04310a813'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:07.680792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786897ddff294a61991cb1a839e50224', 'request_id': 'req-793276b6-021c-4309-bfc6-68a04310a813'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:07.687741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786897ddff294a61991cb1a839e50224', 'request_id': 'req-793276b6-021c-4309-bfc6-68a04310a813'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:07.690806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:07.708486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] The token cache is being invalidate because project 786897ddff294a61991cb1a839e50224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:07.709265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:07.710435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-793276b6-021c-4309-bfc6-68a04310a813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:07.712512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 915/1824] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:07 2022] DELETE /identity/v3/projects/786897ddff294a61991cb1a839e50224 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:07.720201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:07.720618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:07.720776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:07.745689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:07.747405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:07.759038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:07.844586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 910/1825] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:07.854335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:07.854729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:07.855060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:07.881578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:07.882974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:07.891657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 916/1826] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:07.897318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:07.909685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3440-59e1-4f7b-b17f-d0d9a5dce4cd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:07.915087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:07.915707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:07.915986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:07.916259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:07.916922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:07.917215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:07.918889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:07.931684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 911/1827] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:07.936744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:07.948817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a575-2ec9-474d-a0ee-5fac3c108f28 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:07.956555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:07.957290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:07.957467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:07.957781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:07.958520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:07.960596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:07.993769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 917/1828] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:07.998086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.015994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb2bb-3903-4056-9dd6-7ab82a5c667e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.126307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.127017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.127386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.127579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.128253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.130867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.166428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 912/1829] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:07 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:08.170864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.195531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f13b1d-3b32-4acb-9312-c862dbb09784 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.202711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.203555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.204111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.204552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.205446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.208481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.225076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 918/1830] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:08.226429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.247422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebb9b-5175-4317-a490-ba7c4c3f4f22 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.259901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.260860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.261573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.262011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.262948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.268351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56d9fb-74d0-434e-ac7d-4f6b4ba829f4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.300226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 913/1831] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:08.305340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.322691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99eefd-0253-406d-9f4f-e4811a4b319a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.334721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.335428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.335717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.335982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] PATH_INFO: `/v3/projects/1ef7e215872c4a468cf0fbfdccd7040e/users/50f52208a37d4926bf748b94116c3dfc/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.366154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7e215872c4a468cf0fbfdccd7040e, user_id=50f52208a37d4926bf748b94116c3dfc, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.386575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.441166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 919/1832] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:08 2022] PUT /identity/v3/projects/1ef7e215872c4a468cf0fbfdccd7040e/users/50f52208a37d4926bf748b94116c3dfc/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:08.455020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997a27-b6cf-433e-af66-59127a32abad None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.455494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997a27-b6cf-433e-af66-59127a32abad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.455789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95997a27-b6cf-433e-af66-59127a32abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.490412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-95997a27-b6cf-433e-af66-59127a32abad None None] MFA Rules not processed for user `50f52208a37d4926bf748b94116c3dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:08.492881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-95997a27-b6cf-433e-af66-59127a32abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:08.596180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 914/1833] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:08.610955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.614226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:08.707080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9549ad-3c62-4574-bca2-df044e54bce9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.716177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.717272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.717884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.718381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.730086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.731779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceada186-f651-410c-9101-da44bf88025b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.743098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 920/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:08.765252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95997a27-b6cf-433e-af66-59127a32abad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:08.804379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:08.893252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95997a27-b6cf-433e-af66-59127a32abad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:08.900118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:08.901033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:08.901420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:08.901679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] PATH_INFO: `/v3/users/50f52208a37d4926bf748b94116c3dfc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:08.903972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f52208a37d4926bf748b94116c3dfc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:08.907183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:08.986885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f52208a37d4926bf748b94116c3dfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:08.987554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f52208a37d4926bf748b94116c3dfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:08.994776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f52208a37d4926bf748b94116c3dfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.008585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f52208a37d4926bf748b94116c3dfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.009309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f52208a37d4926bf748b94116c3dfc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.023554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 915/1835] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:08 2022] DELETE /identity/v3/users/50f52208a37d4926bf748b94116c3dfc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:09.028368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.028826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.029209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.048969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:09.050454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:09.130026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 921/1836] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:09.140659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:09.142612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:09.247816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec923df-b79b-4212-9612-66d79fe3cd7d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:09.259498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:09.261196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.261702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.262173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.275838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:09.277939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:09.292344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 916/1837] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:09.643636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:09.645323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:09.658945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa9b9e-073e-477b-876e-6de735fbd57b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:09.665192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:09.665961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.666331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.666679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] PATH_INFO: `/v3/users/e905e9144e57404e995fa5f85a3d0aeb` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.668107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e905e9144e57404e995fa5f85a3d0aeb)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:09.670189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:09.717423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:09.750965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e905e9144e57404e995fa5f85a3d0aeb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.753952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e905e9144e57404e995fa5f85a3d0aeb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.768851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e905e9144e57404e995fa5f85a3d0aeb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.773830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:09.775325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:09.796318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c0bdd-ed82-4f4a-b0bd-0629ad1fc01b service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:09.797148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e905e9144e57404e995fa5f85a3d0aeb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.798065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b6b77132-0fe2-41b6-a366-1c7210231156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e905e9144e57404e995fa5f85a3d0aeb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.802512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:09.803166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.803569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.803843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] PATH_INFO: `/v3/projects/1ef7e215872c4a468cf0fbfdccd7040e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.805045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef7e215872c4a468cf0fbfdccd7040e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:09.807125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:09.816005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 922/1838] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:09 2022] DELETE /identity/v3/users/e905e9144e57404e995fa5f85a3d0aeb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:09.822007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.822385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.822827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.837138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:09.856898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:09.859301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:09.873737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef7e215872c4a468cf0fbfdccd7040e', 'request_id': 'req-e602672f-fce6-428e-9089-fca1a6b7a647'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.881768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef7e215872c4a468cf0fbfdccd7040e', 'request_id': 'req-e602672f-fce6-428e-9089-fca1a6b7a647'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.901375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef7e215872c4a468cf0fbfdccd7040e', 'request_id': 'req-e602672f-fce6-428e-9089-fca1a6b7a647'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.921890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] The token cache is being invalidate because project 1ef7e215872c4a468cf0fbfdccd7040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:09.926566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.928591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e602672f-fce6-428e-9089-fca1a6b7a647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:09.932583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 917/1839] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:09 2022] DELETE /identity/v3/projects/1ef7e215872c4a468cf0fbfdccd7040e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:09.949965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8d4b-d936-4fdd-8a97-2e12e3b70e6a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:09.950466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8d4b-d936-4fdd-8a97-2e12e3b70e6a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:09.950897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8d4b-d936-4fdd-8a97-2e12e3b70e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:09.988390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5dbc8d4b-d936-4fdd-8a97-2e12e3b70e6a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:09.989695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5dbc8d4b-d936-4fdd-8a97-2e12e3b70e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:10.009220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 923/1840] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:10.021968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.024547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:10.082316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 918/1841] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:10.091929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.092215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.092493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.119214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:10.120490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:10.133991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 919/1842] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:10.135380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.148996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be1a60-d261-4310-871e-467ca5a6f27a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.154762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.155645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.155813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98fa8-b184-44d6-8201-75ccf8f9f2ec None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.156686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.156970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.157654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:10.157963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.161410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.162063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.162376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.162742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.162891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.174898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.176454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.187950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 920/1843] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:10.193237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.198377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 924/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:10.212938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921b01-e78b-4430-a239-2a6030aca97d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.223924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.224977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.225457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.225958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.227203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.230962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.291631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 921/1845] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:10.296853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.307662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b13af-97ca-4eeb-ab62-c06babc24979 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.387342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:10.408661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.409503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.410005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.410515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.411507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.415424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.461883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 925/1846] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:10 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:10.466549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.479510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210a1d-5579-4eb1-8eb5-0c9fe3f2a518 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.484735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.485461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.485812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.486179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.486959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.488709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.501412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 922/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:10.506565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.517610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236edc-cc3d-4e87-89d1-32ebbf027d74 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.525404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.526751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.527145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.527700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.528960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.530982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830c19-30ad-4af9-9fc2-a4016714a305 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.543146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 926/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:10.547512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.558192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89c3cb-930a-4268-8da8-6dec21c882d2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:10.563338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:10.564029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.564308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.564581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] PATH_INFO: `/v3/projects/5a51a341ef104a15a8f594b35a620f5d/users/895648107ed542a88d6ebc114be8ee42/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.582699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a51a341ef104a15a8f594b35a620f5d, user_id=895648107ed542a88d6ebc114be8ee42, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:10.588437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:10.606802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 923/1849] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:10 2022] PUT /identity/v3/projects/5a51a341ef104a15a8f594b35a620f5d/users/895648107ed542a88d6ebc114be8ee42/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:10.617781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:10.618051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:10.618578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:10.665173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] MFA Rules not processed for user `895648107ed542a88d6ebc114be8ee42`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:10.666923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:10.849299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.854502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:10.873694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 927/1850] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:10.894728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:10.898036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:11.012113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:11.058791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebdcc0-4d3e-4210-849d-5ee970d97d71 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:11.067686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad3cd-2338-47a6-9c5f-7991fc81feef None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:11.069165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:11.070569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:11.071646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:11.072595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] PATH_INFO: `/v3/projects/629230e617a140ff9b17b2fa832b691c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:11.072768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:11.073228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:11.073515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:11.073790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:11.075426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] RBAC: Authorizing `identity:delete_project(project_id=629230e617a140ff9b17b2fa832b691c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:11.080318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:11.084853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:11.086875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:11.119948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 928/1851] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:11.153910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:11.196754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992939f-285b-4fd4-99aa-4d172001cb0b service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:11.203402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629230e617a140ff9b17b2fa832b691c', 'request_id': 'req-c6aefbec-fd60-4d69-a317-5cda08d3410a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.254656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629230e617a140ff9b17b2fa832b691c', 'request_id': 'req-c6aefbec-fd60-4d69-a317-5cda08d3410a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.268082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629230e617a140ff9b17b2fa832b691c', 'request_id': 'req-c6aefbec-fd60-4d69-a317-5cda08d3410a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.285845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] The token cache is being invalidate because project 629230e617a140ff9b17b2fa832b691c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:11.286134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.286981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.290294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 924/1852] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:10 2022] DELETE /identity/v3/projects/629230e617a140ff9b17b2fa832b691c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:11.294564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:11.296601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:11.390827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:11.433532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:11.433532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:11.433532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:11.433532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] PATH_INFO: `/v3/users/895648107ed542a88d6ebc114be8ee42` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:11.436241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895648107ed542a88d6ebc114be8ee42)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:11.448931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:11.495594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefbec-fd60-4d69-a317-5cda08d3410a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:11.518788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:11.520000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:11.520293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:11.520553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] PATH_INFO: `/v3/users/79a9ed4604a74377935e5a2c54589a5a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:11.535667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a9ed4604a74377935e5a2c54589a5a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:11.548042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:11.720174 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895648107ed542a88d6ebc114be8ee42'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.728409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895648107ed542a88d6ebc114be8ee42'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.767857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895648107ed542a88d6ebc114be8ee42'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.778316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a9ed4604a74377935e5a2c54589a5a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.780593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a9ed4604a74377935e5a2c54589a5a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.811369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a9ed4604a74377935e5a2c54589a5a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.817453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895648107ed542a88d6ebc114be8ee42'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.818636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6ada54bd-2e2e-453c-9b4f-13a36f21df36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895648107ed542a88d6ebc114be8ee42'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.838513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:11.858869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a9ed4604a74377935e5a2c54589a5a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.863018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a9ed4604a74377935e5a2c54589a5a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:11.863282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 929/1853] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:11 2022] DELETE /identity/v3/users/895648107ed542a88d6ebc114be8ee42 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:11.874817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:11.875562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:11.876061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:11.892744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 925/1854] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:11 2022] DELETE /identity/v3/users/79a9ed4604a74377935e5a2c54589a5a => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:11.953761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:11.956276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:12.206316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 930/1855] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:12.228411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:12.229976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:12.393730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fac15-4c63-4e01-984e-984f22cdc27a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:12.399449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:12.400172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:12.400375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:12.400691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:12.431741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:12.435883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16d519-49a5-4de6-81e6-955542e0f92b service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:12.466809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 926/1856] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:13.147586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:13.150061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:13.241545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5005e-b295-4549-a7ca-f79647021e93 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:13.266429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:13.267546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.268042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.273273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] PATH_INFO: `/v3/projects/c97888a9b36e4341bfc0efc9215aefc6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.282707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97888a9b36e4341bfc0efc9215aefc6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:13.287170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:13.411768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97888a9b36e4341bfc0efc9215aefc6', 'request_id': 'req-79d9d8a7-8e72-4723-9489-9434efc1a2f1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:13.423359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97888a9b36e4341bfc0efc9215aefc6', 'request_id': 'req-79d9d8a7-8e72-4723-9489-9434efc1a2f1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:13.434131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97888a9b36e4341bfc0efc9215aefc6', 'request_id': 'req-79d9d8a7-8e72-4723-9489-9434efc1a2f1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:13.443893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:13.448422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] The token cache is being invalidate because project c97888a9b36e4341bfc0efc9215aefc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:13.448900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:13.449674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-79d9d8a7-8e72-4723-9489-9434efc1a2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:13.455186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 931/1857] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:13 2022] DELETE /identity/v3/projects/c97888a9b36e4341bfc0efc9215aefc6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:13.456807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.457511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.457511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.481056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:13.483640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:13.646437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 927/1858] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:13.657327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.657604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.657877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.693526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:13.695269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:13.712029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 932/1859] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:13.717000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:13.737271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f976d79-56c9-4aae-952f-d3e7fc9efb35 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:13.761566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:13.763757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.763757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.763757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.765065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:13.765578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:13.774661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:13.803678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 928/1860] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:07:13.814341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:13.816120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:13.822534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:13.842055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8fae-6f3f-4fbe-8421-a8594744a530 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:13.845835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edafeb-ae46-448b-a88b-cbc74ee4c02b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:13.852710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:13.854186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.854882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.855703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.856069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:13.856774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:13.857112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:13.857405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] PATH_INFO: `/v3/projects/5a51a341ef104a15a8f594b35a620f5d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:13.857760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:13.863589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a51a341ef104a15a8f594b35a620f5d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:13.864632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:13.866264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:13.952718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 929/1861] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:13.961529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.017291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a51a341ef104a15a8f594b35a620f5d', 'request_id': 'req-fa7ab091-fda8-4762-8922-5b86c8918433'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:14.033211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a51a341ef104a15a8f594b35a620f5d', 'request_id': 'req-fa7ab091-fda8-4762-8922-5b86c8918433'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:14.057717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a51a341ef104a15a8f594b35a620f5d', 'request_id': 'req-fa7ab091-fda8-4762-8922-5b86c8918433'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:14.106922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] The token cache is being invalidate because project 5a51a341ef104a15a8f594b35a620f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:14.109461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:14.112199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fa7ab091-fda8-4762-8922-5b86c8918433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:14.114723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 933/1862] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:13 2022] DELETE /identity/v3/projects/5a51a341ef104a15a8f594b35a620f5d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:14.142018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e733-e251-4a69-9e03-7cddb2063546 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.142855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e733-e251-4a69-9e03-7cddb2063546 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.143409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e733-e251-4a69-9e03-7cddb2063546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.180441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-53a6e733-e251-4a69-9e03-7cddb2063546 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:14.182393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-53a6e733-e251-4a69-9e03-7cddb2063546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:14.199637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:14.227191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1c26d-ac15-4c37-89f6-645a5d0ec11c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.433724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:14.434911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.435505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.436325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.437979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:14.443845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:14.480811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 934/1863] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:14.480811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92fc0-2767-4004-86dd-91a554ed2e6a None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.480811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92fc0-2767-4004-86dd-91a554ed2e6a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.480811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92fc0-2767-4004-86dd-91a554ed2e6a None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.481195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 935/1864] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:07:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:07:14.489029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd363-205f-402f-98f7-0433ae972d9c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.489466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd363-205f-402f-98f7-0433ae972d9c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.489849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd363-205f-402f-98f7-0433ae972d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.501729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 930/1865] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:13 2022] POST /identity/v3/users => generated 293 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:14.510455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.514173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:14.574330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08ea6-f412-441b-b7df-702b380699ac admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.586477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:14.586477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.586477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.586477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.592726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e6dbd363-205f-402f-98f7-0433ae972d9c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:14.593019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:14.595946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e6dbd363-205f-402f-98f7-0433ae972d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:14.606427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:14.628067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 936/1866] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:14.630559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d060-f293-4702-addf-4e68172e73da None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.630846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d060-f293-4702-addf-4e68172e73da None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.631120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d060-f293-4702-addf-4e68172e73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.654032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dd50d060-f293-4702-addf-4e68172e73da None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:14.655381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd50d060-f293-4702-addf-4e68172e73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:14.675061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 931/1867] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:14.675061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.703871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d39b0-d274-4150-8161-f96bba0f8bbf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.727369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:14.728358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.728836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.729507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.730467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:14.730986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:14.733941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:14.771476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 932/1868] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:14.772610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.802713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dca98-c878-498e-a647-3cd72b5b96cc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.821702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:14.835752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.837279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.838817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.839308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 937/1869] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:07:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:14.841010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50d060-f293-4702-addf-4e68172e73da None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.854279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:14.871152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:14.871439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50d060-f293-4702-addf-4e68172e73da None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.885468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:14.885468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:14.885468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:14.885468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:14.886185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:14.886185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:14.888202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:14.927660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 933/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:14.929510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:14.965068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69877405-b99e-4d8a-85d1-25493ed4935a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:14.992280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 938/1871] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:14 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:14.998132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.005567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.006374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.007967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.008301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] PATH_INFO: `/v3/projects/7f325096ede3415b85f7dfc005ff2ca2/users/243b2f8a97894de5b044654396cabd06/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.037612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f325096ede3415b85f7dfc005ff2ca2, user_id=243b2f8a97894de5b044654396cabd06, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.040427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff35e07-4bdc-42d5-ba19-d73bb49304df admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.077367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 934/1872] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:14 2022] PUT /identity/v3/projects/7f325096ede3415b85f7dfc005ff2ca2/users/243b2f8a97894de5b044654396cabd06/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:15.079132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.080794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.080794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.116997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] MFA Rules not processed for user `243b2f8a97894de5b044654396cabd06`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:15.119132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:15.178434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd1987-1d22-4d6b-86ee-50dfb3a2e132 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.229067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 935/1873] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:15.230089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.233394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:15.270901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:15.281136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.283019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.283426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.284554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.287089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.289352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.332821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 939/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:14 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:15.337162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.358190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f3138-9675-42bc-9e8b-491b5ecb797f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.364180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.364819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.365530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.365530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.366077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.368820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.410320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cab231-77c2-4952-a89b-6a26a65c37d9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.410586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 940/1875] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:15.410586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.518061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:15.526580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872e92-0f54-4e4a-8d43-51cee62ad55c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.538674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.540632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.540936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.541418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.542217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.549678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.571724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 941/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:15.572838 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.587612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb580-4b25-4219-93bb-57edaed447e1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.605266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.605941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.606212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.606532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.607254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.609397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.641678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 942/1877] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:15 2022] POST /identity/v3/users => generated 299 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:15.644515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.666204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.667270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.667861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.668458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.671381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6c471-e000-42b5-b1ca-aa344276e8bd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.680904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.682577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.683236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.683890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.687448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.687673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.694137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.695567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.718375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 936/1878] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:15.720199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.739660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb4ebf-a973-47e9-a9ec-eb384c196fb5 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.751253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.754377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 943/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:15.758478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.759064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.759429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.778315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.778443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.778443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.787014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b1468-2ad5-45f4-9d6e-659d1f646d1d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.795504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.796979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.799029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.799503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] PATH_INFO: `/v3/projects/a5d5d28889de472487bfa1e437467f7d/users/871cf75178d143efb3e09090a125021e/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.809208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 937/1880] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:15.815447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:15.837478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e94-4360-4f20-8493-cd314831b39c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:15.844342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d5d28889de472487bfa1e437467f7d, user_id=871cf75178d143efb3e09090a125021e, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.847396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:15.847593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd86b3a-c3be-4e78-b9e1-98e666495d62 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.848566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.849198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.849734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] PATH_INFO: `/v3/projects/be2f071d125b4780a926207f0a9a28a2/users/3649550117cc454f884d64d5d5e6509d/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.881870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 944/1881] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:15 2022] PUT /identity/v3/projects/a5d5d28889de472487bfa1e437467f7d/users/871cf75178d143efb3e09090a125021e/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:15.901697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fab61-829d-4733-b07e-513dd237f317 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:15.902008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fab61-829d-4733-b07e-513dd237f317 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:15.902307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fab61-829d-4733-b07e-513dd237f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:15.937705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f071d125b4780a926207f0a9a28a2, user_id=3649550117cc454f884d64d5d5e6509d, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:15.940644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:15.958279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-446fab61-829d-4733-b07e-513dd237f317 None None] MFA Rules not processed for user `871cf75178d143efb3e09090a125021e`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:15.959945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-446fab61-829d-4733-b07e-513dd237f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:15.970438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 938/1882] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:15 2022] PUT /identity/v3/projects/be2f071d125b4780a926207f0a9a28a2/users/3649550117cc454f884d64d5d5e6509d/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:15.979017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:16.175750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 945/1883] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:16.183718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fab61-829d-4733-b07e-513dd237f317 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:16.204824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871458c-b305-4edf-a088-b0724c8f7fe2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:16.224113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:16.224113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:16.224565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:16.224697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:16.225390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:16.227933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:16.256192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 939/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:16.259214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:16.277481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:16.293134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097684-d251-4ac5-8753-a3f2152e5ce0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:16.310588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:16.311309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:16.311595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:16.311880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] PATH_INFO: `/v3/projects/be2f071d125b4780a926207f0a9a28a2/users/3649550117cc454f884d64d5d5e6509d/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:16.329506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f071d125b4780a926207f0a9a28a2, user_id=3649550117cc454f884d64d5d5e6509d, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:16.349975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cd424-f5db-4f17-8990-44c5385537e4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:16.394618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 940/1885] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:16 2022] PUT /identity/v3/projects/be2f071d125b4780a926207f0a9a28a2/users/3649550117cc454f884d64d5d5e6509d/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:16.406232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:16.407730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:16.408183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:16.444004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fab61-829d-4733-b07e-513dd237f317 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:16.502746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] MFA Rules not processed for user `3649550117cc454f884d64d5d5e6509d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:16.503913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:16.592242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:16.685829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:16.687233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:16.688150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:16.689005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:16.693182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:16.698748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:16.798201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 946/1886] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:16 2022] POST /identity/v3/projects => generated 375 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:16.804678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:16.850637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 941/1887] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:16.866572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:16.868270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:16.985561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680aed-2292-4a4d-ad36-d285e190129a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:17.007569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:17.008261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.008554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.008871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.009662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:17.010960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c2c2b-b009-4cf9-be3c-457f82af674d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:17.011986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:17.074065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 947/1888] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:16 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:17.074696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:17.127537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26eb86-b204-4844-8c37-3b705484cba8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:17.147560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:17.148615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.149189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.149704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.156360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:17.167215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:17.253700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:17.254847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.257306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 948/1889] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:17.259571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.260384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.264002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:17.350205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337851c-36a3-4d91-9c42-a01b5c8c7f34 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:17.386454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:17.393472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.396152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.397270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.403605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:17.411242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:17.492658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 949/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:17.496284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:17.547741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9304a-4315-4999-a719-5c39838206ed admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:17.574422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:17.576066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.576581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.577033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] PATH_INFO: `/v3/projects/ea4f22f74efc4820837cff63023bac1f/users/d2c7f3eb333f4e598bc22ef0fc4974fe/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.580907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:17.656825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4f22f74efc4820837cff63023bac1f, user_id=d2c7f3eb333f4e598bc22ef0fc4974fe, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:17.684501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a065c-f1c4-4c26-a4a7-feebc5e988e6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:17.737425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:17.751444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:17.759613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 950/1891] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:17 2022] PUT /identity/v3/projects/ea4f22f74efc4820837cff63023bac1f/users/d2c7f3eb333f4e598bc22ef0fc4974fe/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:17.772268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:17.772763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:17.774613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:17.796139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 942/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:17.914823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] MFA Rules not processed for user `d2c7f3eb333f4e598bc22ef0fc4974fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:17.930084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:18.043684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:18.059012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06aa4-a8b4-42b4-a959-f1002402dd2d service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:18.118189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:18.143057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 951/1893] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:18.147995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:18.189773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:18.193602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:18.194339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:18.195104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] PATH_INFO: `/v3/users/243b2f8a97894de5b044654396cabd06` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:18.198141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243b2f8a97894de5b044654396cabd06)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:18.203507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:18.365684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243b2f8a97894de5b044654396cabd06'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:18.372096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243b2f8a97894de5b044654396cabd06'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:18.374274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1f8f8-4ecb-4e07-8b8b-6c3372138aee None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:18.401014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:18.405627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:18.406556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:18.408242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:18.412013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:18.416850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243b2f8a97894de5b044654396cabd06'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:18.421837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:18.468046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243b2f8a97894de5b044654396cabd06'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:18.471171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-74fd0575-96c8-459b-8fa4-5b72dcbc1e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243b2f8a97894de5b044654396cabd06'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:18.521646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 943/1894] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:18 2022] DELETE /identity/v3/users/243b2f8a97894de5b044654396cabd06 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:18.534850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:18.534850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:18.534850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:18.611018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 952/1895] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:18 2022] POST /identity/v3/projects => generated 375 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:18.616443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:18.619768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:18.651519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:18.678282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:18.821849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b506-1611-4e90-aebe-04f760c06ad2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:18.828517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:18.829339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:18.829927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:18.831829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:18.831829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:18.833821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:18.884196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 953/1896] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:18 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:18.891872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:18.964584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab7c8-a166-4ace-b1d8-1c674505bc14 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:18.979517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:18.980574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:18.981066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:18.981560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:18.982865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:18.987707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:19.028994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 944/1897] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:19.046697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 954/1898] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:19.048073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:19.065780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:19.096889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b958-4078-43e7-8c9f-71ecdf88a15e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:19.111817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:19.117076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:19.131797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:19.133180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:19.133686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:19.134169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] PATH_INFO: `/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9/users/7e4778b262da4491b7ac9bf22ba75363/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:19.188328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fec515fdc9d4c1d9f70eca2f33deab9, user_id=7e4778b262da4491b7ac9bf22ba75363, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:19.191890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:19.234356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 945/1899] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:19 2022] PUT /identity/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9/users/7e4778b262da4491b7ac9bf22ba75363/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:19.240317 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:19.320274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64946f-4289-4eb9-9757-bb4201d8f572 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:19.338809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:19.409817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250077d7-0276-4438-9573-527e309b6afe admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:19.421710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:19.423424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:19.424159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:19.424847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:19.426564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:19.432182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:19.470772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 946/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:19.478585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:19.508693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:19.510085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:19.511849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:19.512072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62fc36-10a9-4612-8e92-cb36c1dd141d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:19.512840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:19.525054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:19.526474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:19.527171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:19.528734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] PATH_INFO: `/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9/users/7e4778b262da4491b7ac9bf22ba75363/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:19.536555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fec515fdc9d4c1d9f70eca2f33deab9, user_id=7e4778b262da4491b7ac9bf22ba75363, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:19.537861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:19.540968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119501b-993c-4aab-b025-36e480054769 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:19.544131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:19.568402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 955/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:19.615811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 947/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:19 2022] PUT /identity/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9/users/7e4778b262da4491b7ac9bf22ba75363/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:19.627718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:19.629767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:19.630470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:19.732112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] MFA Rules not processed for user `7e4778b262da4491b7ac9bf22ba75363`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:19.736031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:19.944383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 956/1903] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:19.959405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:19.965460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:20.098493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7194-0ba6-4da1-811d-1b14cb8058ed admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:20.102887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:20.103538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:20.103820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:20.104097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:20.107253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:20.244758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:20.248144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:20.275425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 948/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:21.075816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:21.078142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:21.183671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544b23d-a621-4a63-9ad2-86811dd7ee6f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:21.190023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:21.191247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:21.191661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:21.193134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] PATH_INFO: `/v3/projects/7f325096ede3415b85f7dfc005ff2ca2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:21.194187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f325096ede3415b85f7dfc005ff2ca2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:21.197571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:21.268659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:21.278454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f325096ede3415b85f7dfc005ff2ca2', 'request_id': 'req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.293669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f325096ede3415b85f7dfc005ff2ca2', 'request_id': 'req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.304572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f325096ede3415b85f7dfc005ff2ca2', 'request_id': 'req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.323207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] The token cache is being invalidate because project 7f325096ede3415b85f7dfc005ff2ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:21.323789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.324858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.328930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 957/1905] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:21 2022] DELETE /identity/v3/projects/7f325096ede3415b85f7dfc005ff2ca2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:21.334509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:21.350140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1135bc-fa77-498d-b32c-3198b513515b service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:21.365640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:21.438552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:21.440077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:21.440370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:21.441404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] PATH_INFO: `/v3/users/3649550117cc454f884d64d5d5e6509d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:21.443310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3649550117cc454f884d64d5d5e6509d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:21.446021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:21.544861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3649550117cc454f884d64d5d5e6509d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.545991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3649550117cc454f884d64d5d5e6509d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.563624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3649550117cc454f884d64d5d5e6509d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.592726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3649550117cc454f884d64d5d5e6509d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.593007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3649550117cc454f884d64d5d5e6509d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:21.623469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:21 2022] DELETE /identity/v3/users/3649550117cc454f884d64d5d5e6509d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:22.060006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:22.063404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:22.098902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7edd48-45e7-4f36-9ceb-d57a5eb20985 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:22.193619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:22.194299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.194580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.194854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] PATH_INFO: `/v3/projects/be2f071d125b4780a926207f0a9a28a2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.196066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2f071d125b4780a926207f0a9a28a2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:22.198014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:22.317013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:22.318856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2f071d125b4780a926207f0a9a28a2', 'request_id': 'req-78786547-969b-4aad-9a83-5aaaafeb8c11'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:22.319568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:22.338065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2f071d125b4780a926207f0a9a28a2', 'request_id': 'req-78786547-969b-4aad-9a83-5aaaafeb8c11'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:22.348972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2f071d125b4780a926207f0a9a28a2', 'request_id': 'req-78786547-969b-4aad-9a83-5aaaafeb8c11'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:22.382605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] The token cache is being invalidate because project be2f071d125b4780a926207f0a9a28a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:22.382939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:22.388245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-78786547-969b-4aad-9a83-5aaaafeb8c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:22.394544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:22 2022] DELETE /identity/v3/projects/be2f071d125b4780a926207f0a9a28a2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:22.396089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90612-ef45-4276-bbe3-e6c1a77a875b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.396375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90612-ef45-4276-bbe3-e6c1a77a875b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.396654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90612-ef45-4276-bbe3-e6c1a77a875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.424576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d1d90612-ef45-4276-bbe3-e6c1a77a875b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:22.427625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d1d90612-ef45-4276-bbe3-e6c1a77a875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:22.432745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a71-19a7-4c51-a48a-2e116d367c07 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:22.498947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:22.499867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.500346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.500839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.503618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:22.510412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:22.595733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:22.597561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:22.600932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 959/1908] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:22.617003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.617827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.618208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.629789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 950/1909] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:22.639386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:22.703154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:22.706139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:22.738433 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:22.738776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 960/1910] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:22.755389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0594b-90d6-4b81-b30f-a49308a59ed1 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:22.783661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:22.785555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.787618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.788134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.790130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:22.790963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:22.796039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:22.842778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 951/1911] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:22.847319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:22.881568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894d7ca-753f-498b-9b11-a761b6024a01 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:22.905075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:22.906172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:22.906685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:22.907160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:22.908029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:22.910200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:22.981458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 961/1912] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:22 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:22.989858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.004793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160284-ed5d-4e1f-b5f4-b780251f2459 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:23.191468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:23.192443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.194039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.194590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.195657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:23.198200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:23.246357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 952/1913] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:22 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:23.248739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.283452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979f7f-190f-4d2b-9072-1f4fd3bd3c2d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:23.304439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:23.306214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.306878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.307363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.308638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:23.313548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:23.353999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.363600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 962/1914] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:23.376114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59388a-591e-4618-9d37-d33b46f20f5c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:23.386018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:23.387083 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.387584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.388053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.389280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:23.393041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7f1d8-e3d5-4e0f-84c5-82d2c0e12aec admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:23.436691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 953/1915] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:23.444550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.488969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575996-5e45-4100-848e-1c5470495aa5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:23.502436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:23.506537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.506878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.507169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] PATH_INFO: `/v3/projects/cb1e06fa929643c4aa7ea31062d2da42/users/8c2eda0b2dd1453f9ed3cf3221ba1f84/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.576330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1e06fa929643c4aa7ea31062d2da42, user_id=8c2eda0b2dd1453f9ed3cf3221ba1f84, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:23.583050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:23.643995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 963/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:23 2022] PUT /identity/v3/projects/cb1e06fa929643c4aa7ea31062d2da42/users/8c2eda0b2dd1453f9ed3cf3221ba1f84/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:23.646475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.646764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.647069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.734319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] MFA Rules not processed for user `8c2eda0b2dd1453f9ed3cf3221ba1f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:23.735507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:23.798590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.801186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:23.850556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:23.863149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 954/1917] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:23.867353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:23.911346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606611-db05-4c7c-8689-688372587682 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:23.916210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:23.916858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:23.917199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:23.917473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:23.919428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:23.995017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd45a2-9cfb-4be7-be89-bb8c1aa1e80f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.001169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.001837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.002138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.002443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.005515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.006996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.040997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.041338 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 955/1918] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:23 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:24.047228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.049293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.070031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 964/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:24.152062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bd9e-15f0-4e46-9a67-a5004c30bc08 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.168546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.170345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.171140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.171960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.173604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.178936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.247305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 956/1920] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:24 2022] POST /identity/v3/users => generated 310 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:24.249825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.263090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8648-424b-44d5-954f-7841b395a258 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.277179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.277846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.278099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.278404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.279135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.282162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.317479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.330551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 965/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:24.335795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ccce-afc8-4f9f-98ea-da8fcae08e8e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.341631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.342901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.342901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.343116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] PATH_INFO: `/v3/projects/5c96da7b5b9e4c6385856660ae630699/users/0ba315c8daaf4682b4d1178a946d5e31/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.372826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c96da7b5b9e4c6385856660ae630699, user_id=0ba315c8daaf4682b4d1178a946d5e31, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.375938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.399718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 957/1922] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:24 2022] PUT /identity/v3/projects/5c96da7b5b9e4c6385856660ae630699/users/0ba315c8daaf4682b4d1178a946d5e31/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:24.405854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.431475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45441-aea2-430b-a829-276b96757c07 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.498231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:24.536544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.537531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.538009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.538334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.540806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.542200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755ccb5-601c-4ff7-aa9d-e9061f048e4d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.558681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 966/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:24.562779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.594618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b11835-0d69-44bd-b4d3-3e546212bc20 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.604778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.605765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.606177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.606632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] PATH_INFO: `/v3/projects/5c96da7b5b9e4c6385856660ae630699/users/0ba315c8daaf4682b4d1178a946d5e31/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.609441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c96da7b5b9e4c6385856660ae630699, user_id=0ba315c8daaf4682b4d1178a946d5e31, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.613719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.636851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 958/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:24 2022] PUT /identity/v3/projects/5c96da7b5b9e4c6385856660ae630699/users/0ba315c8daaf4682b4d1178a946d5e31/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:24.641419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff54206-6486-46bf-b110-55d46d787422 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.641751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff54206-6486-46bf-b110-55d46d787422 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.642051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff54206-6486-46bf-b110-55d46d787422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.675377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-eff54206-6486-46bf-b110-55d46d787422 None None] MFA Rules not processed for user `0ba315c8daaf4682b4d1178a946d5e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:24.676655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eff54206-6486-46bf-b110-55d46d787422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:24.834550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 967/1925] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:24 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:24.854832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:24.942175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:24.959372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd423-2985-409e-ba00-1da61d6c8cf4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:24.963538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:24.964424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:24.964697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:24.965044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:24.976325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:24.977788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:24.990290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 959/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:24 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:25.224030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff54206-6486-46bf-b110-55d46d787422 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:25.238334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff54206-6486-46bf-b110-55d46d787422 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:25.242422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:25.243051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:25.243331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:25.243609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:25.324614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:25.328149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a615db-d191-450a-94a1-2db493b38bd2 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:25.340319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 968/1927] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:25 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:29.847744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:29.849058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:30.043100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf841-14d1-4ce1-a140-1324eeff27dd service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:30.059803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:30.060892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:30.061375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:30.061859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] PATH_INFO: `/v3/users/871cf75178d143efb3e09090a125021e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:30.069424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871cf75178d143efb3e09090a125021e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:30.073248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:30.179188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871cf75178d143efb3e09090a125021e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:30.180590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871cf75178d143efb3e09090a125021e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:30.206821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871cf75178d143efb3e09090a125021e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:30.230270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871cf75178d143efb3e09090a125021e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:30.231040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871cf75178d143efb3e09090a125021e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:30.250040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 960/1928] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:29 2022] DELETE /identity/v3/users/871cf75178d143efb3e09090a125021e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:30.255254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:30.256471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:30.257050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:30.281142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:30.282637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:30.413282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:30.436751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 969/1929] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:30.458167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:30.460336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:30.579107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53632a94-727d-4d54-8553-abf793a237e3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:30.585188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:30.586986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:30.586986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:30.587374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:30.611991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:30.615725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:30.637511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 961/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:31.102022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:31.104662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:31.142108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa015-1045-4c94-886a-370e3f349d3c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:31.156161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:31.158081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:31.159064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:31.160092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] PATH_INFO: `/v3/projects/a5d5d28889de472487bfa1e437467f7d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:31.162675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d5d28889de472487bfa1e437467f7d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:31.166432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:31.266049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d5d28889de472487bfa1e437467f7d', 'request_id': 'req-fef51bff-64a9-4cee-b90c-1739ecb10eff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.280673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d5d28889de472487bfa1e437467f7d', 'request_id': 'req-fef51bff-64a9-4cee-b90c-1739ecb10eff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.293580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d5d28889de472487bfa1e437467f7d', 'request_id': 'req-fef51bff-64a9-4cee-b90c-1739ecb10eff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.308370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] The token cache is being invalidate because project a5d5d28889de472487bfa1e437467f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:31.308700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.309489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.311313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 970/1931] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:31 2022] DELETE /identity/v3/projects/a5d5d28889de472487bfa1e437467f7d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:31.320268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:31.327890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:31.335234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d695048-a3a2-45da-bf6c-9ec73beba0b5 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:31.421571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:31.422220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:31.422554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:31.422836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] PATH_INFO: `/v3/users/d2c7f3eb333f4e598bc22ef0fc4974fe` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:31.424008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c7f3eb333f4e598bc22ef0fc4974fe)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:31.426047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:31.491894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c7f3eb333f4e598bc22ef0fc4974fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.492617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c7f3eb333f4e598bc22ef0fc4974fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.501334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c7f3eb333f4e598bc22ef0fc4974fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.517611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c7f3eb333f4e598bc22ef0fc4974fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.518923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c7f3eb333f4e598bc22ef0fc4974fe'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:31.535922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 962/1932] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:31 2022] DELETE /identity/v3/users/d2c7f3eb333f4e598bc22ef0fc4974fe => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:31.945758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:31.947662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:31.963599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51bff-64a9-4cee-b90c-1739ecb10eff admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:32.045543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:32.046517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:32.046943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:32.047443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] PATH_INFO: `/v3/projects/ea4f22f74efc4820837cff63023bac1f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:32.050128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4f22f74efc4820837cff63023bac1f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:32.053957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:32.135756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4f22f74efc4820837cff63023bac1f', 'request_id': 'req-dfb53a2d-effb-46ef-90fa-61b34a5e1563'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.147762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4f22f74efc4820837cff63023bac1f', 'request_id': 'req-dfb53a2d-effb-46ef-90fa-61b34a5e1563'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.160393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4f22f74efc4820837cff63023bac1f', 'request_id': 'req-dfb53a2d-effb-46ef-90fa-61b34a5e1563'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.179288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] The token cache is being invalidate because project ea4f22f74efc4820837cff63023bac1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:32.180021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.180871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.185785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 971/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:31 2022] DELETE /identity/v3/projects/ea4f22f74efc4820837cff63023bac1f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:32.187820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:32.190463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:32.229423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2779-f78d-453b-a5dc-443d254f159c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:32.321154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:32.321782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:32.322574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:32.322574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] PATH_INFO: `/v3/users/7e4778b262da4491b7ac9bf22ba75363` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:32.323738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4778b262da4491b7ac9bf22ba75363)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:32.325722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:32.359009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:32.395379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4778b262da4491b7ac9bf22ba75363'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.396169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4778b262da4491b7ac9bf22ba75363'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.408398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4778b262da4491b7ac9bf22ba75363'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.446180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4778b262da4491b7ac9bf22ba75363'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.448823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b21a1bb6-f9e4-4b2e-955b-f2e195bd7692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4778b262da4491b7ac9bf22ba75363'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.488702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 963/1934] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:32 2022] DELETE /identity/v3/users/7e4778b262da4491b7ac9bf22ba75363 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:32.693315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:32.695018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:32.717134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53a2d-effb-46ef-90fa-61b34a5e1563 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:32.731527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:32.809858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:32.810972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:32.810972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:32.811260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] PATH_INFO: `/v3/users/8c2eda0b2dd1453f9ed3cf3221ba1f84` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:32.812391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2eda0b2dd1453f9ed3cf3221ba1f84)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:32.814529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:32.882130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2eda0b2dd1453f9ed3cf3221ba1f84'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.882893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2eda0b2dd1453f9ed3cf3221ba1f84'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.892454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2eda0b2dd1453f9ed3cf3221ba1f84'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.910090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2eda0b2dd1453f9ed3cf3221ba1f84'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.911184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2eda0b2dd1453f9ed3cf3221ba1f84'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:32.928571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 972/1935] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:32 2022] DELETE /identity/v3/users/8c2eda0b2dd1453f9ed3cf3221ba1f84 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:32.934812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:32.935451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:32.937873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:32.941181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:32.942908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:32.968536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:32.970523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.043468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98f24-d098-4fde-a28e-9787ca52c7dd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.050043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.051047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.051377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.051656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] PATH_INFO: `/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.053218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fec515fdc9d4c1d9f70eca2f33deab9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.055738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.079276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 964/1936] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:33.091355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.093754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.107911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:33.133376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fec515fdc9d4c1d9f70eca2f33deab9', 'request_id': 'req-f8889937-038f-42f4-9a3c-fb6726104fd9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:33.146107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fec515fdc9d4c1d9f70eca2f33deab9', 'request_id': 'req-f8889937-038f-42f4-9a3c-fb6726104fd9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:33.162767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fec515fdc9d4c1d9f70eca2f33deab9', 'request_id': 'req-f8889937-038f-42f4-9a3c-fb6726104fd9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:33.181018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] The token cache is being invalidate because project 0fec515fdc9d4c1d9f70eca2f33deab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:33.181591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:33.182574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f8889937-038f-42f4-9a3c-fb6726104fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:33.188740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 973/1937] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:32 2022] DELETE /identity/v3/projects/0fec515fdc9d4c1d9f70eca2f33deab9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:33.192657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5997-05bb-484f-b95d-e6910e456d25 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.192967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5997-05bb-484f-b95d-e6910e456d25 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.193221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5997-05bb-484f-b95d-e6910e456d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.207220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bb724-39c0-4426-b7c7-86ce7dc86395 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.215635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-741c5997-05bb-484f-b95d-e6910e456d25 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:33.216862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-741c5997-05bb-484f-b95d-e6910e456d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.311758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.312552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.312837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.313114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.315027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.328787 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:33.334330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 974/1938] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:33.344384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.344837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.345098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.370521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:33.371754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.381233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 975/1939] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:33.385819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.395368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3983b2-acb7-4060-9549-1cc6c4138238 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.401906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.402690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.403250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.403250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.403745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:33.404250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.405970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.419451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 976/1940] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:33.420980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.422627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.424198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.436492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7949a6-24ba-412c-9c2e-ad1b5e5973e1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.438199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 965/1941] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:33.442140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.442816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.443100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.443380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.444030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.445998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.487853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 977/1942] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:33 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:33.489703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.501058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38daf-3478-4f2b-8aad-80cee8fbb2a1 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.577132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.577851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.578132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.578447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.579090 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.581100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.614062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 966/1943] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:33 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:33.615955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.630490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056049e-6b15-4973-aeb8-fb89fbf0182e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.636491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.637046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.638070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.638070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.638584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.640075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.654323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 978/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:33.662323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.695278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bbb06-9ae9-465b-bb20-1c0672e5cc4a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.722794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.723922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.724435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.724942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.726113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.728986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157576-09fa-473f-b49a-31bc203cd95b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.744267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 967/1945] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:33.751499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.776049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2400d-7568-4cfc-ad52-0fb5b219640a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.783763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.784933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.785211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.785559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] PATH_INFO: `/v3/projects/72c46faf83db4afa9c7d6826e4dad844/users/7c65d9f403734db28e4113943328c7a9/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.810681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c46faf83db4afa9c7d6826e4dad844, user_id=7c65d9f403734db28e4113943328c7a9, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.816248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:33.841309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 979/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:33 2022] PUT /identity/v3/projects/72c46faf83db4afa9c7d6826e4dad844/users/7c65d9f403734db28e4113943328c7a9/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:33.858701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.858992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.859265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.867104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:33.872959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.923857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] MFA Rules not processed for user `7c65d9f403734db28e4113943328c7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:33.925604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:33.946803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:33.972037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ca5e-81c1-4abf-ac28-64229b17d3cb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:33.977650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:33.978358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:33.978641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:33.978915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] PATH_INFO: `/v3/projects/cb1e06fa929643c4aa7ea31062d2da42` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:33.980137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1e06fa929643c4aa7ea31062d2da42)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:33.982062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.031563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 968/1947] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:34.037676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.047273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1e06fa929643c4aa7ea31062d2da42', 'request_id': 'req-6396bc76-a7aa-480f-a527-3b8e61b09d0b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.054091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9b85-2355-4675-b00e-2cb247fb1279 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.058946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1e06fa929643c4aa7ea31062d2da42', 'request_id': 'req-6396bc76-a7aa-480f-a527-3b8e61b09d0b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.067254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1e06fa929643c4aa7ea31062d2da42', 'request_id': 'req-6396bc76-a7aa-480f-a527-3b8e61b09d0b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.074511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:34.089599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] The token cache is being invalidate because project cb1e06fa929643c4aa7ea31062d2da42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:34.090067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.091149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.094047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 980/1948] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:33 2022] DELETE /identity/v3/projects/cb1e06fa929643c4aa7ea31062d2da42 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:34.100366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.102340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:34.140093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.140628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.140905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.141183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.141934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.144619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.183179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 969/1949] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:34.189012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.191273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:34.246147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bc76-a7aa-480f-a527-3b8e61b09d0b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.332718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e24d-ecd5-4ade-a87d-1f35ea5e7231 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.345491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.346724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.348375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.348375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.348799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.353722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.401986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 970/1950] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:34 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:34.409001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.437756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b23e95-9dcf-4254-b245-0af311c992de admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.459980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.460410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.460619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.460962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] PATH_INFO: `/v3/users/0ba315c8daaf4682b4d1178a946d5e31` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.460962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba315c8daaf4682b4d1178a946d5e31)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.460962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.475225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.477429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.477429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.477429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.477880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.480830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.497354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 971/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:34.498742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.511970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:34.521792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c85c3-a476-4a72-b0f9-214fea8019b4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.531453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.532595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.533148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.533652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.534937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.538622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.551349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba315c8daaf4682b4d1178a946d5e31'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.552070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba315c8daaf4682b4d1178a946d5e31'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.561095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba315c8daaf4682b4d1178a946d5e31'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.567261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 972/1952] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:34.575176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:34.576329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba315c8daaf4682b4d1178a946d5e31'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.577105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-498f1025-d0d9-4d46-b21f-b0543e5486ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba315c8daaf4682b4d1178a946d5e31'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:34.578131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:34.594211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 981/1953] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:34 2022] DELETE /identity/v3/users/0ba315c8daaf4682b4d1178a946d5e31 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:34.607236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af912166-8a88-45ff-9b0c-93a2f3895daa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:34.728708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:34.729378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.729658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.729965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] PATH_INFO: `/v3/projects/c3d24ad37523407aa41a6437397a66a2/users/ad487e87b46640dc868b90c97543b299/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.744567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:34.750996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d24ad37523407aa41a6437397a66a2, user_id=ad487e87b46640dc868b90c97543b299, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:34.756284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:34.775263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 973/1954] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:34 2022] PUT /identity/v3/projects/c3d24ad37523407aa41a6437397a66a2/users/ad487e87b46640dc868b90c97543b299/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:34.788226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:34.789518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:34.790695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:34.828641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] MFA Rules not processed for user `ad487e87b46640dc868b90c97543b299`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:34.829899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:34.940011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 982/1955] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:34.945050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.030089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.032442 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.054915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b943-341b-40ab-92d1-371483d4bc4f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.062087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.063108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.063511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.063865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.065363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.067654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.119858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 974/1956] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:35.124270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.136285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca1657-79a3-4c1e-b546-d8fc65fc2da9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.193968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:35.229347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.230140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.230363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.230588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] PATH_INFO: `/v3/projects/5c96da7b5b9e4c6385856660ae630699` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.231907 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c96da7b5b9e4c6385856660ae630699)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.232985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4f74-8800-43f2-bdf1-5418ea3a8ae7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.234020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.246451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.246451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.246451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.246451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.246848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.247614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.270841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 975/1957] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:35.274789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.285896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f024-091c-428f-92a7-6c5a0c37d626 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.287493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c96da7b5b9e4c6385856660ae630699', 'request_id': 'req-96cb2031-1c86-49dc-b132-6af4f9dcab54'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:35.296097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c96da7b5b9e4c6385856660ae630699', 'request_id': 'req-96cb2031-1c86-49dc-b132-6af4f9dcab54'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:35.303979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c96da7b5b9e4c6385856660ae630699', 'request_id': 'req-96cb2031-1c86-49dc-b132-6af4f9dcab54'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:35.318536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] The token cache is being invalidate because project 5c96da7b5b9e4c6385856660ae630699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:35.319168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:35.320591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-96cb2031-1c86-49dc-b132-6af4f9dcab54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:35.323874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 983/1958] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:35 2022] DELETE /identity/v3/projects/5c96da7b5b9e4c6385856660ae630699 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:35.329107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635e1a-588e-4747-97be-a6b13c956bd1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.329459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635e1a-588e-4747-97be-a6b13c956bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.329827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635e1a-588e-4747-97be-a6b13c956bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.361233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e2635e1a-588e-4747-97be-a6b13c956bd1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:35.361586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.362937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.363256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.363493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e2635e1a-588e-4747-97be-a6b13c956bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.363604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.364157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.365842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.372956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 984/1959] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:35.376798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 976/1960] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:35.381826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.382016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.382338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.382641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.383800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.391962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:35.399058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bb58a-f1f4-4167-b553-352000dbccb8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.404675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.405178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:35.405362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.405642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.405920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] PATH_INFO: `/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2/users/e250b28c4a124721865c72376e4ccd43/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.406450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.415569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 985/1961] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:35.420108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.426487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e92a55034846ccb44c7cb4bd9e26d2, user_id=e250b28c4a124721865c72376e4ccd43, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.428205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.431518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb60e0-7912-46e1-a3af-406416bcde04 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.443711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.445223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.445718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.447331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 977/1962] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:35 2022] PUT /identity/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2/users/e250b28c4a124721865c72376e4ccd43/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:35.447471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.451147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:35.451465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.452048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.453114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.470223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 986/1963] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:07:35.473492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.484655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9283-2566-47db-8690-f38b6ae95a22 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.544326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281506e7-95af-454b-abba-a835d405fb5b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.553404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.555200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.555818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.556362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.557814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.561001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.577860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.578612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.578848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.579131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.579837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.583837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 978/1964] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:35.588078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.589352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.617272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f9be-680a-4f8e-9e7a-f206bdb0f38d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.628145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.629419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.629928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.630612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] PATH_INFO: `/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2/users/e250b28c4a124721865c72376e4ccd43/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.634438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e92a55034846ccb44c7cb4bd9e26d2, user_id=e250b28c4a124721865c72376e4ccd43, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.644495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb786-584d-4a09-b659-0bbf201e8eb1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.654812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 987/1965] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:35.657906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.670938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 979/1966] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:35 2022] PUT /identity/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2/users/e250b28c4a124721865c72376e4ccd43/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:35.682498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.682966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.683307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.710742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:35.760987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac292-881f-47e9-8139-c54b7987e0d4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:35.761270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] MFA Rules not processed for user `e250b28c4a124721865c72376e4ccd43`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:35.763124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.880512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:35.883085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:35.883520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:35.883675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:35.884333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:35.891942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:35.952989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 988/1967] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:35.954542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 980/1968] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:35.959304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.969749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:35.971641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:35.996317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce49f6-7b48-4574-a548-d90a2b7b8ade admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.012584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.013162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.013452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.013729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.014717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.016481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.033636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 989/1969] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:36.039333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.052044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdda0c-feb7-4cff-bb55-18de006cb7b3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.061602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.062311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.062601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.062883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.063593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.066619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.071199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:36.082952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d066cce-8f31-419e-8a79-a39c8b3a2d16 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.085856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 990/1970] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:36.086927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.089643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.090874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.091327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.092399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.095460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:36.098484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010044a-1fed-4324-9b63-6bbf93d971c4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.103928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.104773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.105061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.105344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] PATH_INFO: `/v3/projects/08b33a664c6a45f7a1bb081170d980f9/users/06f8a0bbc8c444c28e0174a8cbcd1fcd/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.126033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b33a664c6a45f7a1bb081170d980f9, user_id=06f8a0bbc8c444c28e0174a8cbcd1fcd, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.131182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654263e2-6661-4a16-a2a4-2dd69b6d6e1d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.150085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 991/1971] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:36 2022] PUT /identity/v3/projects/08b33a664c6a45f7a1bb081170d980f9/users/06f8a0bbc8c444c28e0174a8cbcd1fcd/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:36.162387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.162662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.163296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.200122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.202879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.209587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] MFA Rules not processed for user `06f8a0bbc8c444c28e0174a8cbcd1fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:36.210365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:36.216005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 981/1972] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:36.308939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 992/1973] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:36.314215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.340848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7c04-0571-4645-8830-cd899fc58f9d service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.454172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.455260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.455548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.455816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.456469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.458426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.502686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 982/1974] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:36 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:36.511381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.535322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc8ef-69ed-4167-920b-afd3796d068c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.544623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:36.655621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.655621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.655621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.655621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.656223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.657425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.720980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 993/1975] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:36 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:36.727209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.739241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164873-219d-465d-bb81-ee11abc4823d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.747314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.748042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.748376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.749300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.750000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.751889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.768320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 983/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:36.772672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.791007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b109-388c-48b9-a014-b9932f3565a1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.791547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.792473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.792813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.792948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] PATH_INFO: `/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39/users/e060835de46c4858b9363911c09f90c3/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.811161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0dc130f1ad47dab9a0f48aa40a3e39, user_id=e060835de46c4858b9363911c09f90c3, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.814103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.828449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 994/1977] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:36 2022] PUT /identity/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39/users/e060835de46c4858b9363911c09f90c3/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:36.833500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.851945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6e9f3-762d-47af-92f5-0432f8a396a7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.942478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.943097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.943384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.943659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.944315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.945968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bab3f1-31f6-447f-8e3e-2f736fff5e8a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.957407 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 984/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:36.962117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:36.974633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caf674-4bf2-4ce6-98d7-588a6dc2e701 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:36.980715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:36.981334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:36.981660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:36.981902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] PATH_INFO: `/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39/users/e060835de46c4858b9363911c09f90c3/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:36.983945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0dc130f1ad47dab9a0f48aa40a3e39, user_id=e060835de46c4858b9363911c09f90c3, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:36.986687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:36.998047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 995/1979] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:36 2022] PUT /identity/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39/users/e060835de46c4858b9363911c09f90c3/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:37.010621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:37.010907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:37.011202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:37.034838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:37.046408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] MFA Rules not processed for user `e060835de46c4858b9363911c09f90c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:37.048408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:37.132187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 985/1980] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:37.146510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:37.261620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e642bf-b872-4d29-af61-fa77540570c0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:37.266792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:37.267705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:37.268186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:37.269147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:37.360388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:37.362483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:37.373572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 996/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:38.247934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:38.252065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:38.271541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522264-76f2-4908-84c6-ffc36bc3dce7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:38.278440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:38.279108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:38.280298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:38.280298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:38.282685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:38.396929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:38.398715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:38.410663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 986/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:39.385603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:39.397304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbeb80-a271-41a9-9a71-a68c4821a17d service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:39.402500 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:39.403474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:39.403766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:39.404080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:39.421323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:39.533381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:39.538173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5f25-8864-43e7-b7af-c13ad5244330 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:39.559438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 997/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:41.191926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:41.195641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:41.390937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eb41e-4841-4fde-b8a7-22d6b035ca00 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:41.399735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:41.400836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:41.401119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:41.401410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] PATH_INFO: `/v3/users/f8e85286c14f4610b98cf0e25cdb9fc6` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:41.402750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e85286c14f4610b98cf0e25cdb9fc6)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:41.404770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:41.474718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:41.492825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e85286c14f4610b98cf0e25cdb9fc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:41.494218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e85286c14f4610b98cf0e25cdb9fc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:41.511822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e85286c14f4610b98cf0e25cdb9fc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:41.552233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e85286c14f4610b98cf0e25cdb9fc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:41.554228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e85286c14f4610b98cf0e25cdb9fc6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:41.587213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 987/1984] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:41 2022] DELETE /identity/v3/users/f8e85286c14f4610b98cf0e25cdb9fc6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:41.592076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:41.592599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:41.592599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:41.629949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:41.632057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:41.706752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 998/1985] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:41.720808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:41.722450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:41.800929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba9f8-d1b1-4608-b131-1f827cee31cb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:41.804798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:41.805424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:41.805709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:41.805986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:41.816674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:41.818144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52beb23-8ed8-4a84-80d6-d03e56d3280a service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:41.828863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 988/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:42.267948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:42.270924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:42.286101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4cb64-374d-4812-8b03-d18c58e3c27f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:42.293361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:42.294045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.294386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.294663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] PATH_INFO: `/v3/projects/c7258a067492434bab1f725f48766982` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.296246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7258a067492434bab1f725f48766982)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:42.298190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:42.407387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7258a067492434bab1f725f48766982', 'request_id': 'req-d1cd15ec-5512-45db-838b-497d95b703dc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:42.419714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7258a067492434bab1f725f48766982', 'request_id': 'req-d1cd15ec-5512-45db-838b-497d95b703dc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:42.439504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7258a067492434bab1f725f48766982', 'request_id': 'req-d1cd15ec-5512-45db-838b-497d95b703dc'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:42.462635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] The token cache is being invalidate because project c7258a067492434bab1f725f48766982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:42.462900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:42.463696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:42.466579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 999/1987] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:42 2022] DELETE /identity/v3/projects/c7258a067492434bab1f725f48766982 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:42.472989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ad79-612d-44be-8494-d51d58bd9041 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.474040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ad79-612d-44be-8494-d51d58bd9041 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.474866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ad79-612d-44be-8494-d51d58bd9041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.509574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8789ad79-612d-44be-8494-d51d58bd9041 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:42.512325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8789ad79-612d-44be-8494-d51d58bd9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:42.553883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:42.556005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:42.617316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:42.646193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 989/1988] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:42.653803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.654234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.655427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.662933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd15ec-5512-45db-838b-497d95b703dc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:42.667343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:42.667973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.668251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.668529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.670536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:42.682030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:42.683354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:42.694482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 990/1989] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:42.698444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:42.723409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5de198-c52b-42b7-b36d-95a8271efc5d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:42.728960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:42.729739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.730096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.730474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.731212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:42.731621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:42.733275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:42.749877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 991/1990] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:07:42.754496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:42.770843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8092-4d58-4b1c-b8b5-1deb19c3a8ae admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:42.771913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:42.773664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:42.782231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:42.785251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.787263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.787942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.789523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:42.791262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1000/1991] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:42.793751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:42.847081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 992/1992] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:42 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:42.851345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:42.869927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5778b19-8447-4f53-baa0-b7b6e965f77a service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:42.948275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:42.948917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:42.949881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:42.949881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:42.950447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:42.952338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:42.987746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1001/1993] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:42 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:42.991468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:43.012999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46e3e-a73b-4c38-bf63-f7afa573c6af admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:43.020298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:43.020991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:43.021282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:43.021601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:43.023448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:43.023972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:43.045613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 993/1994] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:43.048871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:43.064108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804395-b904-44bd-8ce6-511d0e88a220 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:43.072139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:43.073484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:43.074262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:43.074851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:43.075944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:43.079230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09106c-86b1-4acf-8915-a79bc18e9152 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:43.103871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1002/1995] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:43.105862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:43.116493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:43.123149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986e4b-ad1d-442d-bb0d-b398cfb1f549 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:43.133973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:43.135553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:43.136231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:43.137085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] PATH_INFO: `/v3/projects/ff9856f530f64763b2ecbd30481a1a34/users/ae09efb445734fd298a35b7a1a11469a/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:43.181105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9856f530f64763b2ecbd30481a1a34, user_id=ae09efb445734fd298a35b7a1a11469a, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:43.188715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:43.219707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 994/1996] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:43 2022] PUT /identity/v3/projects/ff9856f530f64763b2ecbd30481a1a34/users/ae09efb445734fd298a35b7a1a11469a/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:43.236698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:43.236975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:43.237369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:43.288574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] MFA Rules not processed for user `ae09efb445734fd298a35b7a1a11469a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:43.289844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:43.362617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:43.388440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1003/1997] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:43.402863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:43.474436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a5d23-20b7-4dc8-ad73-69cf5e337d86 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:43.474993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:43.475409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:43.475888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:43.476232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:43.487333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:43.488881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac619-7ee1-45d7-9ced-bd6c20689e39 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:43.499813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 995/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:45.162148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:45.165752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:45.303747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939752-1303-4d03-93cb-0c88bd11b766 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:45.318546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:45.319931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:45.320321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:45.320714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] PATH_INFO: `/v3/users/7c65d9f403734db28e4113943328c7a9` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:45.323112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c65d9f403734db28e4113943328c7a9)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:45.325856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:45.410172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c65d9f403734db28e4113943328c7a9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:45.412559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c65d9f403734db28e4113943328c7a9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:45.427172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c65d9f403734db28e4113943328c7a9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:45.477011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c65d9f403734db28e4113943328c7a9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:45.478136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c65d9f403734db28e4113943328c7a9'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:45.514518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1004/1999] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:45 2022] DELETE /identity/v3/users/7c65d9f403734db28e4113943328c7a9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:45.517372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:45.518002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:45.518940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:45.546594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:45.547862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:45.641951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 996/2000] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:45.654367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:45.657259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:45.750199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ff176-aab6-40f1-b40b-5e9650b043cb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:45.754826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:45.755704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:45.756121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:45.756416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:45.768817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:45.770524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:45.785897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1005/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:46.171294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:46.172932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:46.185332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9556aa-5a79-481c-aa20-850e40fb6ff2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:46.191435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:46.192095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:46.192374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:46.192652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] PATH_INFO: `/v3/projects/72c46faf83db4afa9c7d6826e4dad844` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:46.193947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c46faf83db4afa9c7d6826e4dad844)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:46.196092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:46.248821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c46faf83db4afa9c7d6826e4dad844', 'request_id': 'req-26ed5add-83b9-4825-8b68-9b9b05acad23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.255769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c46faf83db4afa9c7d6826e4dad844', 'request_id': 'req-26ed5add-83b9-4825-8b68-9b9b05acad23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.265124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c46faf83db4afa9c7d6826e4dad844', 'request_id': 'req-26ed5add-83b9-4825-8b68-9b9b05acad23'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.287062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] The token cache is being invalidate because project 72c46faf83db4afa9c7d6826e4dad844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:46.287353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.288061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.289723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 997/2002] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:46 2022] DELETE /identity/v3/projects/72c46faf83db4afa9c7d6826e4dad844 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:46.294610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:46.305093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fc45-c268-4dc7-9858-962cb83d3b28 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:46.313362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:46.381078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:46.381737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:46.382022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:46.382337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] PATH_INFO: `/v3/users/ad487e87b46640dc868b90c97543b299` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:46.383511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad487e87b46640dc868b90c97543b299)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:46.385501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:46.439299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad487e87b46640dc868b90c97543b299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.441490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad487e87b46640dc868b90c97543b299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.458899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad487e87b46640dc868b90c97543b299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.478431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad487e87b46640dc868b90c97543b299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.479634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad487e87b46640dc868b90c97543b299'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:46.497789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1006/2003] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:46 2022] DELETE /identity/v3/users/ad487e87b46640dc868b90c97543b299 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:46.833255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:46.838269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:46.873357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed5add-83b9-4825-8b68-9b9b05acad23 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:46.881362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:46.973809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:46.974891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:46.975298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:46.975455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] PATH_INFO: `/v3/projects/c3d24ad37523407aa41a6437397a66a2` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:46.978539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d24ad37523407aa41a6437397a66a2)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:46.980708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:47.059573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d24ad37523407aa41a6437397a66a2', 'request_id': 'req-6fc4e873-fa68-490e-8a8f-d862b14d35da'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.075253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d24ad37523407aa41a6437397a66a2', 'request_id': 'req-6fc4e873-fa68-490e-8a8f-d862b14d35da'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.095085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d24ad37523407aa41a6437397a66a2', 'request_id': 'req-6fc4e873-fa68-490e-8a8f-d862b14d35da'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.100414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:47.104486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:47.110473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] The token cache is being invalidate because project c3d24ad37523407aa41a6437397a66a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:47.111147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.112681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.116300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 998/2004] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:46 2022] DELETE /identity/v3/projects/c3d24ad37523407aa41a6437397a66a2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:47.125034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:47.127183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:47.131484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffc2-f669-473c-bce4-1dda99d2e2bb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:47.222645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:47.223247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:47.223573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:47.223864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] PATH_INFO: `/v3/users/ae09efb445734fd298a35b7a1a11469a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:47.225006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae09efb445734fd298a35b7a1a11469a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:47.227114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:47.236257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e873-fa68-490e-8a8f-d862b14d35da admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:47.243380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:47.244416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:47.244708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:47.245389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] PATH_INFO: `/v3/users/e250b28c4a124721865c72376e4ccd43` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:47.246717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e250b28c4a124721865c72376e4ccd43)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:47.250292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:47.273928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:47.310134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae09efb445734fd298a35b7a1a11469a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.311350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae09efb445734fd298a35b7a1a11469a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.319846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:47.328171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae09efb445734fd298a35b7a1a11469a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.337141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e250b28c4a124721865c72376e4ccd43'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.338543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e250b28c4a124721865c72376e4ccd43'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.351811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e250b28c4a124721865c72376e4ccd43'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.360121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae09efb445734fd298a35b7a1a11469a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.361021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae09efb445734fd298a35b7a1a11469a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.373104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e250b28c4a124721865c72376e4ccd43'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.374069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-261edadb-02a0-46d2-be8d-bc0a1a13ba6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e250b28c4a124721865c72376e4ccd43'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:47.395636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 999/2006] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:47 2022] DELETE /identity/v3/users/e250b28c4a124721865c72376e4ccd43 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:47.396112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1007/2006] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:47 2022] DELETE /identity/v3/users/ae09efb445734fd298a35b7a1a11469a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:47.397860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:47.398149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:47.398471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:47.421584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:47.423014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:47.506279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1000/2007] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:47.522204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:47.523739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:47.619390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630cd2d-e3b3-424d-9675-9ecf7647f3c0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:47.692331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:47.692979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:47.693264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:47.693542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:47.709166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:47.710715 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:47.724171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1008/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:48.084768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.087620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.119093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4ef2-b0ee-442f-a78b-e30dcf4faad8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.135187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:48.136692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.137343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.137925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] PATH_INFO: `/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.142119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e92a55034846ccb44c7cb4bd9e26d2)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:48.171052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:48.196958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.199133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.230737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1dfe-85ed-46d1-99d6-83557b3127e6 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.245325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:48.245997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.246613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.246951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] PATH_INFO: `/v3/users/06f8a0bbc8c444c28e0174a8cbcd1fcd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.249548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f8a0bbc8c444c28e0174a8cbcd1fcd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:48.251555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:48.313014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e92a55034846ccb44c7cb4bd9e26d2', 'request_id': 'req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.322022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e92a55034846ccb44c7cb4bd9e26d2', 'request_id': 'req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.346771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e92a55034846ccb44c7cb4bd9e26d2', 'request_id': 'req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.354554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f8a0bbc8c444c28e0174a8cbcd1fcd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.356159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f8a0bbc8c444c28e0174a8cbcd1fcd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.372477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f8a0bbc8c444c28e0174a8cbcd1fcd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.384140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] The token cache is being invalidate because project c0e92a55034846ccb44c7cb4bd9e26d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:48.384726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.385683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a0c3f0d1-010f-4e85-90e0-c3b2763841b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.387294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:48.387991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1001/2009] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:48 2022] DELETE /identity/v3/projects/c0e92a55034846ccb44c7cb4bd9e26d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:48.393885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3731-525a-4206-bb66-3f886b426eb0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.396341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3731-525a-4206-bb66-3f886b426eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.396907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c3731-525a-4206-bb66-3f886b426eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.420925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f8a0bbc8c444c28e0174a8cbcd1fcd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.426856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f8a0bbc8c444c28e0174a8cbcd1fcd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.429243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2f3c3731-525a-4206-bb66-3f886b426eb0 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:48.430884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2f3c3731-525a-4206-bb66-3f886b426eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.482891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1009/2010] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:48 2022] DELETE /identity/v3/users/06f8a0bbc8c444c28e0174a8cbcd1fcd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:48.486303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.495124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.497690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:48.566800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1002/2011] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:48.566800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38b06-3f3a-4a6d-a7df-112a1947afaa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.566800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38b06-3f3a-4a6d-a7df-112a1947afaa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.566800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38b06-3f3a-4a6d-a7df-112a1947afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.593437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-83e38b06-3f3a-4a6d-a7df-112a1947afaa None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:48.594850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-83e38b06-3f3a-4a6d-a7df-112a1947afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.629167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912ef72-a182-41c6-af1b-b029f38e1fe3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.634903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:48.635854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.636215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.636530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] PATH_INFO: `/v3/projects/ff9856f530f64763b2ecbd30481a1a34` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.638128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9856f530f64763b2ecbd30481a1a34)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:48.640161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:48.716208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1003/2012] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:48.718663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4389-a3f5-42bc-89fb-371f29e09a98 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.722351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4389-a3f5-42bc-89fb-371f29e09a98 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.722677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4389-a3f5-42bc-89fb-371f29e09a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.737355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9856f530f64763b2ecbd30481a1a34', 'request_id': 'req-d17305ea-9c82-4833-ac37-faf27874bc80'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.747749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9856f530f64763b2ecbd30481a1a34', 'request_id': 'req-d17305ea-9c82-4833-ac37-faf27874bc80'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.751241 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7e0e4389-a3f5-42bc-89fb-371f29e09a98 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:48.753281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7e0e4389-a3f5-42bc-89fb-371f29e09a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.757882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9856f530f64763b2ecbd30481a1a34', 'request_id': 'req-d17305ea-9c82-4833-ac37-faf27874bc80'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.777324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] The token cache is being invalidate because project ff9856f530f64763b2ecbd30481a1a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:48.777694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.778591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:48.781668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1010/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:48 2022] DELETE /identity/v3/projects/ff9856f530f64763b2ecbd30481a1a34 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:48.782611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.784787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.850036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1004/2014] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:48.851945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.852486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.853020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.880087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:48.881974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.883628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17305ea-9c82-4833-ac37-faf27874bc80 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.890384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:48.891375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.891982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.892440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.896159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.898148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1005/2015] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:48.898840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.918066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:48.920332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd339c0-48fb-4912-a628-2cafc143f551 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:48.920525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42e787-7ce4-4d19-96df-caebf4f28bb8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.926440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:48.927246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.927531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.927840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.928549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:48.928862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:48.930629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:48.936607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1011/2016] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:48.938134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:48.938632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:48.938983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:48.953359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1006/2017] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:48.956954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.967776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:48.970563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:48.981284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1012/2018] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:48.985765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:48.995843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fac090-0cf5-40e7-a0d4-23e9d925d5cd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:48.999020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf5f13-b665-4490-af9c-2e163641a43a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.004492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.005320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.005597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.006085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.007071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:49.007599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.008850 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.009492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.009665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.009815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.010063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.010745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.011995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:49.018797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.028061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1013/2019] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:07:49.032867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.051103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b66b3f-8633-499f-9c0e-ef9703d0392c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.069902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.072536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.073295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.073860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.075160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.078896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.079608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1007/2020] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:48 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:49.084095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.142318 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1014/2021] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:49 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:49.145957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.165748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:49.212982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119b66-5025-43f3-b307-26a3e3d041d2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.316802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dae0e6-2e16-457b-a1db-898cde8a98c3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.331826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.332760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.333162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.333859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.334802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.337141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.345606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.347373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.348514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.348514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.349538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.353581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.397576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1008/2022] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:49 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:49.398531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.402461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1015/2023] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:49 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:49.406852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.420577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783c4e-b4d7-4100-b51e-b2c56e9e9763 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.426822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.427783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.428273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.428406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10439862-d691-4c3b-880d-74d7e912a470 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.429061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.430019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.432830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.439389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.440570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.440870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.442029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.446110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.448252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.466278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1009/2024] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:49.467932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.479309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1016/2025] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:49.480319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.490932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3ada-3e68-4bf7-9583-6147c292e14b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.497800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.498941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.498941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.499390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.500194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361d68-4a10-4536-9149-8774dde2f7d1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.500352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.503442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.506813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.507441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.507726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.508243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.508694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.510344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.522513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1010/2026] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:49.525984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1017/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:49.527373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.527751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.539688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd47d1-5508-4a92-bf54-269416ff52b8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.545116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3586b-d9cc-4cc2-ae0a-05768054873d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.547901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.549547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.554533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.558978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] PATH_INFO: `/v3/projects/849fc1f867324835aeab6284d4ae02c3/users/648e71a91fb6405c8195fab36d580e00/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.560328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.563074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.564070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.564355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] PATH_INFO: `/v3/projects/367afb60a8384d1096ba6be0b079dba6/users/378acf6fcacb45d398043cf64520af83/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.582058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=849fc1f867324835aeab6284d4ae02c3, user_id=648e71a91fb6405c8195fab36d580e00, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.584919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.614832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=367afb60a8384d1096ba6be0b079dba6, user_id=378acf6fcacb45d398043cf64520af83, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.618417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af4e7-19e9-42d3-b771-5c209f989e1e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.635548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1011/2028] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:49 2022] PUT /identity/v3/projects/849fc1f867324835aeab6284d4ae02c3/users/648e71a91fb6405c8195fab36d580e00/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:49.635548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.635548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:49.650880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1018/2029] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:49 2022] PUT /identity/v3/projects/367afb60a8384d1096ba6be0b079dba6/users/378acf6fcacb45d398043cf64520af83/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:49.652092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31abb-329e-412d-9b91-0566a6810f03 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.653091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31abb-329e-412d-9b91-0566a6810f03 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.653311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31abb-329e-412d-9b91-0566a6810f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.690938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ebf31abb-329e-412d-9b91-0566a6810f03 None None] MFA Rules not processed for user `648e71a91fb6405c8195fab36d580e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:49.692316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ebf31abb-329e-412d-9b91-0566a6810f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:49.757020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc85511-5bb0-4ae4-92bd-720d45872bdc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:49.782596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1019/2030] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:49.784291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.784291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.784481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.796399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:49.828214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] MFA Rules not processed for user `378acf6fcacb45d398043cf64520af83`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:49.829602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:49.833312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:49.883248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:49.885190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:49.886058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:49.887501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] PATH_INFO: `/v3/projects/08b33a664c6a45f7a1bb081170d980f9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:49.890686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b33a664c6a45f7a1bb081170d980f9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:49.895313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:49.949614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1020/2031] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:49.950899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:49.955118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:49.987910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b33a664c6a45f7a1bb081170d980f9', 'request_id': 'req-7a2cc0b5-1363-4313-90a0-1ac96533e383'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:49.996719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b33a664c6a45f7a1bb081170d980f9', 'request_id': 'req-7a2cc0b5-1363-4313-90a0-1ac96533e383'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.011199 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b33a664c6a45f7a1bb081170d980f9', 'request_id': 'req-7a2cc0b5-1363-4313-90a0-1ac96533e383'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.030100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] The token cache is being invalidate because project 08b33a664c6a45f7a1bb081170d980f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:50.030759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.032945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.044600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1012/2032] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:49 2022] DELETE /identity/v3/projects/08b33a664c6a45f7a1bb081170d980f9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:50.045622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:50.047169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e6296-00ad-4b59-8f70-177b3e6791f4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:50.055943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:50.174969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc0b5-1363-4313-90a0-1ac96533e383 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:50.178197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:50.179013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:50.179141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:50.179491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:50.179873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:50.179978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:50.180064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:50.180310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:50.182050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:50.183661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:50.283525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:50.284989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:50.286055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:50.288084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:50.295661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1013/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:50.296328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:50.297679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:50.319148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1021/2034] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:50.332577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:50.441864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258fdbf-12a9-4f0f-95bf-805f3f84ee53 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:50.448678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:50.449592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:50.449975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:50.450394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] PATH_INFO: `/v3/users/e060835de46c4858b9363911c09f90c3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:50.452056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e060835de46c4858b9363911c09f90c3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:50.454228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:50.586969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e060835de46c4858b9363911c09f90c3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.589143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e060835de46c4858b9363911c09f90c3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.607187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e060835de46c4858b9363911c09f90c3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.648993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e060835de46c4858b9363911c09f90c3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.652373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6fbd3d0-b59b-4618-8518-ea646d735ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e060835de46c4858b9363911c09f90c3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:50.692193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1014/2035] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:50 2022] DELETE /identity/v3/users/e060835de46c4858b9363911c09f90c3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:51.231157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.242645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:51.253082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d8198-1a3d-40a9-84d8-27b19f668cfc service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.339466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.340470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.340740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.341195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] PATH_INFO: `/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.342883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0dc130f1ad47dab9a0f48aa40a3e39)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.345696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:51.397659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0dc130f1ad47dab9a0f48aa40a3e39', 'request_id': 'req-253a3b31-0ada-4d56-9812-41c15613f9f2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:51.406355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0dc130f1ad47dab9a0f48aa40a3e39', 'request_id': 'req-253a3b31-0ada-4d56-9812-41c15613f9f2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:51.413824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0dc130f1ad47dab9a0f48aa40a3e39', 'request_id': 'req-253a3b31-0ada-4d56-9812-41c15613f9f2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:51.428284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] The token cache is being invalidate because project fc0dc130f1ad47dab9a0f48aa40a3e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:51.428635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:51.429393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-253a3b31-0ada-4d56-9812-41c15613f9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:51.430998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1022/2036] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:51 2022] DELETE /identity/v3/projects/fc0dc130f1ad47dab9a0f48aa40a3e39 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:51.437264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.438180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.438769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.463608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:51.465535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:51.552310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1015/2037] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:51.560496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.563597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.563597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.589873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:51.592766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:51.606483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1023/2038] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:51.612335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.631935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8f75-cf3e-42bf-9c09-95323dc0678a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.637397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.638125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.638488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.638810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.639680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:51.640206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.641962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:51.660913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1016/2039] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:51.666106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.680518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875965e6-476b-4b30-a1ee-8c7d6acd0014 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.687962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.688605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.688893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.689175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.689902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.692006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:51.759114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1024/2040] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:51 2022] POST /identity/v3/projects => generated 359 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:51.761158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.780512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf866-4d46-4236-8631-988e43ef4be5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.832800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:51.881144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.881956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.882110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.882355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.883000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.885145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:51.911657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1017/2041] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:51 2022] POST /identity/v3/users => generated 280 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:51.916184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.928499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40f31-243a-4d22-bb89-4eef8b424a3c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.943331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.943993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.943993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.944410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.947132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.948912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:51.965188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1025/2042] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:51.970599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:51.982915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63335-9685-4d21-8ee4-e035502d93a2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:51.990274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:51.991178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:51.991611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:51.992055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:51.993633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:51.995586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba727ab-c3ee-4954-b4a7-833b7e2cf059 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:52.020044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1018/2043] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:52.024720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:52.042412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39021e-b3d2-4182-bf20-3aa9f1ef2f52 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:52.049143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:52.050814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:52.050814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:52.051140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] PATH_INFO: `/v3/projects/3cf8a4ce02f844918efb7f7b8aee4349/users/020772e820e64266a0d77d5d3ec54ae9/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:52.069871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf8a4ce02f844918efb7f7b8aee4349, user_id=020772e820e64266a0d77d5d3ec54ae9, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:52.072923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:52.092075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1026/2044] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:52 2022] PUT /identity/v3/projects/3cf8a4ce02f844918efb7f7b8aee4349/users/020772e820e64266a0d77d5d3ec54ae9/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:52.109668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:52.110140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:52.110664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:52.147626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] MFA Rules not processed for user `020772e820e64266a0d77d5d3ec54ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:52.149173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:52.332607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1019/2045] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:52.395703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:52.401602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:52.463149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:52.513155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea290-b69c-4ca6-b31f-540bc85479d4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:52.519277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:52.520774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:52.521601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:52.522360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:52.540189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:52.542515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ca533-9874-4fc8-967a-12c1b4cf6b2a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:52.555707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1027/2046] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:52.574081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:52.745372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bb72c-609f-4ea7-8ae5-d80ab278ad44 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:52.759377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:52.760326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:52.761034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:52.761609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] PATH_INFO: `/v3/users/020772e820e64266a0d77d5d3ec54ae9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:52.764450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020772e820e64266a0d77d5d3ec54ae9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:52.768989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:52.857085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:52.867892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020772e820e64266a0d77d5d3ec54ae9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:52.869493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020772e820e64266a0d77d5d3ec54ae9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:52.894126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020772e820e64266a0d77d5d3ec54ae9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:52.916357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020772e820e64266a0d77d5d3ec54ae9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:52.917546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020772e820e64266a0d77d5d3ec54ae9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:52.945544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1020/2047] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:52 2022] DELETE /identity/v3/users/020772e820e64266a0d77d5d3ec54ae9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:52.952676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:52.953385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:52.953665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:52.988517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:52.991319 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:53.152710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1028/2048] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:53.165482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:53.167654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:53.255889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760d52e-f071-46cf-904f-a981a1ab8133 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:53.260886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:53.261158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:53.261305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:53.261623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:53.285611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:53.288394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191b71-36ff-418f-825c-d70d5e6f21ef service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:53.305584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1021/2049] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:53.886396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:53.889939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:53.919722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8b8fc-4362-4418-bd2e-d7bee574d9f8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:53.928457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:53.929983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:53.930905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:53.931709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] PATH_INFO: `/v3/projects/3cf8a4ce02f844918efb7f7b8aee4349` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:53.944074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf8a4ce02f844918efb7f7b8aee4349)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:53.947250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.021568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf8a4ce02f844918efb7f7b8aee4349', 'request_id': 'req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.030835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf8a4ce02f844918efb7f7b8aee4349', 'request_id': 'req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.038615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf8a4ce02f844918efb7f7b8aee4349', 'request_id': 'req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.056086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] The token cache is being invalidate because project 3cf8a4ce02f844918efb7f7b8aee4349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:54.056845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.058086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f1d2f19-0148-4dea-95d4-ad6469dc4cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.059945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1029/2050] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:53 2022] DELETE /identity/v3/projects/3cf8a4ce02f844918efb7f7b8aee4349 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:54.068293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.068849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.068849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.115683 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:54.117193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.238789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1022/2051] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:54.248271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891d40-35dd-4439-8041-73104b451ced None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.248643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891d40-35dd-4439-8041-73104b451ced None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.249182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891d40-35dd-4439-8041-73104b451ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.276357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c7891d40-35dd-4439-8041-73104b451ced None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:54.277775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c7891d40-35dd-4439-8041-73104b451ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.294900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1030/2052] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:54.300426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.312361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391890d1-e371-4fdb-9e69-c1d12bfabc9d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.318437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.319192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.319543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.319898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.320655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:54.321046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.322998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.338000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1023/2053] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:07:54.342727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891d40-35dd-4439-8041-73104b451ced None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.360566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891d40-35dd-4439-8041-73104b451ced None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.383796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.384740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.385243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.385699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.401750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.402803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.404910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.405490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.433495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249797d-0919-4203-8ab1-64ef7e4f3169 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.442859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.443607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.443894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.444177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] PATH_INFO: `/v3/users/378acf6fcacb45d398043cf64520af83` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.457418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378acf6fcacb45d398043cf64520af83)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.459487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.479094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1031/2054] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:54.485172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.543330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:54.551228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:54.563318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378acf6fcacb45d398043cf64520af83'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.565786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378acf6fcacb45d398043cf64520af83'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.583991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378acf6fcacb45d398043cf64520af83'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.606133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378acf6fcacb45d398043cf64520af83'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.607285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97559f27-9c02-4191-b564-bfc335a07f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378acf6fcacb45d398043cf64520af83'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:54.621749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f183-1340-4dd7-b56a-ff9f55357b01 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.628619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.629417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.629707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.630028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.630754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.631422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1024/2055] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:54 2022] DELETE /identity/v3/users/378acf6fcacb45d398043cf64520af83 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:54.633258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.640692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.641100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.641310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.662969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1032/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:54.667265 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.669884 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.676306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:54.677720 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.687328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8479-14fa-4983-980b-fa3f7078d82d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.779085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1025/2057] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:54.788951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.791112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:54.798193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.799733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.800655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.801581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.803342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.808334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.831633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1033/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:54.836059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.851768 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741eee-2b17-4e77-9e24-a54e78be1764 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.859204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.860262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.860678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.861056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.862402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.864619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.880934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1034/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:54.885290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:54.908968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e699-d84b-445e-a875-af973d62d855 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.915830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.917572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.917938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.918909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] PATH_INFO: `/v3/projects/7fdc145039844cb49a59dcd4700592f9/users/c70ae4f9dfab4a81b725bcbeb608685f/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.947091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdc145039844cb49a59dcd4700592f9, user_id=c70ae4f9dfab4a81b725bcbeb608685f, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:54.954964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e9a47-f1e5-45fe-9a90-c13cbcc4fec4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:54.959165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd4b4-59b9-4441-a71c-07d2f81a6045 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:54.972845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:54.973096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.978448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.978833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:54.983206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1035/2060] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:54 2022] PUT /identity/v3/projects/7fdc145039844cb49a59dcd4700592f9/users/c70ae4f9dfab4a81b725bcbeb608685f/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:54.996998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:54.998591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:54.999788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.003109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.005870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.019099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1026/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:55.060847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] MFA Rules not processed for user `c70ae4f9dfab4a81b725bcbeb608685f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:55.062376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.127605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.129060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.153464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c2540-e025-4d87-8cb3-ff57cdb4a2f8 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.201868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1036/2062] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:55.203008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.217812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:55.258739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.261772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.262118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.262288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] PATH_INFO: `/v3/users/b3493c19a0c5463cb536583401c7d22e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.264821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3493c19a0c5463cb536583401c7d22e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.268758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.275483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:55.310011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae23e4-28a9-4869-b15e-4e38a5ecb881 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.317987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.318940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.319767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.320246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.321091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.323257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.363463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1037/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:55 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:55.367007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3493c19a0c5463cb536583401c7d22e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.367339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.368244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3493c19a0c5463cb536583401c7d22e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.369445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.378540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3493c19a0c5463cb536583401c7d22e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.405512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3493c19a0c5463cb536583401c7d22e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.407028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3493c19a0c5463cb536583401c7d22e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.424257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1027/2064] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:55 2022] DELETE /identity/v3/users/b3493c19a0c5463cb536583401c7d22e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:07:55.472678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3185-132e-4e52-810b-79f9225cd0af admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.561993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.562699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.563665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.563853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.565669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.569604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.596059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1038/2065] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:55 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:07:55.600515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.618533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523238-bfe9-4ad2-ab4b-974f85040e10 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.625052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.625798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.626145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.626562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.627870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.629585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.644502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1028/2066] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:55.646113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.661703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10156a19-3295-40fe-a129-2481e35c0205 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.667460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.670058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.670058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.670058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] PATH_INFO: `/v3/projects/d149870bdf994527bfcea8955d27488c/users/af3e886d442c4d14b8233c0abef0120a/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.686899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.689021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.710473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a964-c0db-4207-9734-a3440dcfd9ba admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.716440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.717149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.717434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.717710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] PATH_INFO: `/v3/projects/367afb60a8384d1096ba6be0b079dba6` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.718065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d149870bdf994527bfcea8955d27488c, user_id=af3e886d442c4d14b8233c0abef0120a, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.718880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] RBAC: Authorizing `identity:delete_project(project_id=367afb60a8384d1096ba6be0b079dba6)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.721074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.721340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.739205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1039/2067] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:55 2022] PUT /identity/v3/projects/d149870bdf994527bfcea8955d27488c/users/af3e886d442c4d14b8233c0abef0120a/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:55.740486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.742827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.753870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:55.782527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367afb60a8384d1096ba6be0b079dba6', 'request_id': 'req-872655db-bce6-47e2-8141-d21921c3244d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.789612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367afb60a8384d1096ba6be0b079dba6', 'request_id': 'req-872655db-bce6-47e2-8141-d21921c3244d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.798396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367afb60a8384d1096ba6be0b079dba6', 'request_id': 'req-872655db-bce6-47e2-8141-d21921c3244d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.809749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] The token cache is being invalidate because project 367afb60a8384d1096ba6be0b079dba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:55.810040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.810735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.812321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1029/2068] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:55 2022] DELETE /identity/v3/projects/367afb60a8384d1096ba6be0b079dba6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:55.813082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.815255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.817219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d26ef-fd13-4338-a541-c2bbed0908ac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.868491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:55.876460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.877872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.878158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.878457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] PATH_INFO: `/v3/projects/af074a55acaf4cc7acb9dd1e2e5d50ed` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.879802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af074a55acaf4cc7acb9dd1e2e5d50ed)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.881762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.882860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872655db-bce6-47e2-8141-d21921c3244d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:55.889225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:55.889858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.890368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.890678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.891340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:55.892963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5adb5-fb30-4024-8e41-5b206eb001e8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:55.903175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1030/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:55.904530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e8e3-1d69-42d7-b59b-9370fee862d1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:55.904819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e8e3-1d69-42d7-b59b-9370fee862d1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:55.905103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525e8e3-1d69-42d7-b59b-9370fee862d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:55.927173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b525e8e3-1d69-42d7-b59b-9370fee862d1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:55.928437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b525e8e3-1d69-42d7-b59b-9370fee862d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:55.941663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af074a55acaf4cc7acb9dd1e2e5d50ed', 'request_id': 'req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.953329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af074a55acaf4cc7acb9dd1e2e5d50ed', 'request_id': 'req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.963652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af074a55acaf4cc7acb9dd1e2e5d50ed', 'request_id': 'req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.980658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] The token cache is being invalidate because project af074a55acaf4cc7acb9dd1e2e5d50ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:07:55.981035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.981935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:07:55.984982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1040/2070] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:07:55 2022] DELETE /identity/v3/projects/af074a55acaf4cc7acb9dd1e2e5d50ed => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:55.985999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:55.988719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.028124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1031/2071] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:56.028124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e3fa-fd25-4185-a440-e0d7fc2274fc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.028124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e3fa-fd25-4185-a440-e0d7fc2274fc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.028124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e3fa-fd25-4185-a440-e0d7fc2274fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.050380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d95e3fa-fd25-4185-a440-e0d7fc2274fc None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:56.051731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d95e3fa-fd25-4185-a440-e0d7fc2274fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.060595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1032/2072] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:56.061882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7edb-9f02-485d-98a2-f11fe7448282 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.062024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7edb-9f02-485d-98a2-f11fe7448282 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.062346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7edb-9f02-485d-98a2-f11fe7448282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.066140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:56.083500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-835c7edb-9f02-485d-98a2-f11fe7448282 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:56.084730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-835c7edb-9f02-485d-98a2-f11fe7448282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.093561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1033/2073] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:56.094856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.095154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.095450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.096155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2222-7e4e-4be0-8bb7-ce28ce5f0783 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.102996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.104164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.104661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.105161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] PATH_INFO: `/v3/projects/d149870bdf994527bfcea8955d27488c/users/af3e886d442c4d14b8233c0abef0120a/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.108821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d149870bdf994527bfcea8955d27488c, user_id=af3e886d442c4d14b8233c0abef0120a, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.115307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.117223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:56.118471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.129369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1041/2074] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:55 2022] PUT /identity/v3/projects/d149870bdf994527bfcea8955d27488c/users/af3e886d442c4d14b8233c0abef0120a/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:56.133122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.133299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1034/2075] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:56.134890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.148379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625816ff-b96e-41c8-a595-0f5c90f7b317 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.223749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626554-8a2d-4e43-8992-16702ef98740 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.228752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.229369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.229648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.229919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.230389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.230618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:56.230919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.231329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.231765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.232118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.232806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a093fb-ff6d-4bb3-b1aa-655dc03e99a5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.232927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:07:56.233196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.234901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.247779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1042/2076] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:56.249086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.249372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.249664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.253860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1035/2077] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:07:56.254719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.265790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad3c1-6eb7-43b2-afaa-1d8e20b4f6a6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.270811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.271436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.271716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.272091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.272634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.274697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.278895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] MFA Rules not processed for user `af3e886d442c4d14b8233c0abef0120a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:56.280100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.313757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1036/2078] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:56.314868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.380442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:56.387810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1043/2079] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:07:56.389634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.409557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed5828-fb81-4295-8f3c-8f2d1fe10a68 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.410905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd0535-b98c-44cd-a6ed-d68fa056980c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.416862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.417956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.418532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.418814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.419129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.419242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.419549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.419820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.420318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.420818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.422470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.424154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.454181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1044/2080] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:56.455575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.457324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.463305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1037/2081] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:56.465830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.548186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:56.577092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3266e9-54bf-476a-94b6-d1c04aea2867 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.584259 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f91cf-ac4c-400c-8af4-1c96bb2b8efa admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.586029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.586716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.586999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.587275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.587950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.589851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.603493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1038/2082] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:56.604772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.630326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dee066-d062-4c6d-8de9-5a95430f7eb7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.640336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.641653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.646808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.647070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.662508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.662508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.715600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.716434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.716725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.717003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.720310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.766017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1039/2083] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:07:56.768756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.790415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d863-ac0c-4636-82dd-03301852c6d4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.798922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.799581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.800122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.802302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.802302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.805292 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.817010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.818899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.829633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1045/2084] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:56.830625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1040/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:56.834386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.839894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.846731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e597-9ee2-4e0a-b17f-dae286ae968f service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.853325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.853931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.854081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb60-aa94-4cd2-8fa2-1957b90810ad admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.854230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.854519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.855180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.857052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.861521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.862504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.862876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.863263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] PATH_INFO: `/v3/projects/c4d05e4df1b94368a145c961b06c1644/users/1b765b23cd2140979234a96624e57492/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.871497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1046/2086] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:07:56.875737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.885203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d05e4df1b94368a145c961b06c1644, user_id=1b765b23cd2140979234a96624e57492, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.887506 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a83b14-4109-47f8-8bb5-ae6c70fbfce1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:56.888676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.893672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:56.894413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.894977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.895278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.896061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:56.897999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54d6e-fb9a-4e22-a7f5-ebadc8fc97c5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:56.909792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1047/2087] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:07:56.910992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1041/2088] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:56 2022] PUT /identity/v3/projects/c4d05e4df1b94368a145c961b06c1644/users/1b765b23cd2140979234a96624e57492/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:56.915006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:56.916613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:56.916961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:56.917228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:56.939112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:56.940875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:56.998743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0e71-8701-424c-97b4-d7c026c8340c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:57.005121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:57.005815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:57.006108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:57.006528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] PATH_INFO: `/v3/projects/e793cca35be34d0d923301f9b249dc8a/users/d75237bf836149b6b08d8d63b821f0dd/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:57.024514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1048/2089] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:57.032171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e793cca35be34d0d923301f9b249dc8a, user_id=d75237bf836149b6b08d8d63b821f0dd, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:57.035034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:57.036669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:57.038590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c5612-c557-47d0-bfe4-96974415ba60 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:57.045366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:57.063873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1042/2090] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:07:56 2022] PUT /identity/v3/projects/e793cca35be34d0d923301f9b249dc8a/users/d75237bf836149b6b08d8d63b821f0dd/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:07:57.075858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:57.076151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:57.076443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:57.078972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:07:57.108464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] MFA Rules not processed for user `d75237bf836149b6b08d8d63b821f0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:07:57.109726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:57.120454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadbda-d6d7-412f-88c3-8544f39a776e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:57.230415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:57.231178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:57.231823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:57.232435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:57.260183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1043/2091] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:07:57.276537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:57.280086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:07:57.328056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:57.329611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:57.356463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1049/2092] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:07:57.444186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7ef9-d4e9-488d-81ae-7b67d81e4369 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:57.454844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:57.456136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:57.456667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:57.457113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:57.474314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:57.480197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84ca14-9d4a-44c9-bcfd-d06a19ac7929 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:07:57.498011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1044/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:07:59.813522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:07:59.846613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fb471-310f-488e-8c2c-146d2c56703b service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:07:59.861559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:07:59.862343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:07:59.862862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:07:59.864743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] PATH_INFO: `/v3/users/c70ae4f9dfab4a81b725bcbeb608685f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:07:59.890267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70ae4f9dfab4a81b725bcbeb608685f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:07:59.894459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:00.081368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70ae4f9dfab4a81b725bcbeb608685f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:00.086276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70ae4f9dfab4a81b725bcbeb608685f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:00.093510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70ae4f9dfab4a81b725bcbeb608685f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:00.122006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70ae4f9dfab4a81b725bcbeb608685f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:00.123437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70ae4f9dfab4a81b725bcbeb608685f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:00.160243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1050/2094] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:07:59 2022] DELETE /identity/v3/users/c70ae4f9dfab4a81b725bcbeb608685f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:00.165238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:00.167859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:00.168561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:00.216911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:00.218835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:00.351912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1045/2095] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:00.372068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:00.387090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:00.433266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:00.572026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec060-2a7f-4f76-866a-98e56f0a2969 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:00.579250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:00.580719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:00.583082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:00.583623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:00.605977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:00.608263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:00.624126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1051/2096] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:01.154336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:01.158685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:01.199039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7160e-7408-471a-8e9e-1289eff3ac0f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:01.216643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:01.217317 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:01.217605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:01.217883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] PATH_INFO: `/v3/projects/7fdc145039844cb49a59dcd4700592f9` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:01.220284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdc145039844cb49a59dcd4700592f9)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:01.222601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:01.231025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:01.302832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdc145039844cb49a59dcd4700592f9', 'request_id': 'req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.321139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdc145039844cb49a59dcd4700592f9', 'request_id': 'req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.331864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdc145039844cb49a59dcd4700592f9', 'request_id': 'req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.347148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] The token cache is being invalidate because project 7fdc145039844cb49a59dcd4700592f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:01.347440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.348054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.350042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1046/2097] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:01 2022] DELETE /identity/v3/projects/7fdc145039844cb49a59dcd4700592f9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:01.355091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:01.369271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2dde3-9fc0-4ba8-95d2-3ca3e71abbd5 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:01.462485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:01.465644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:01.466300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:01.466762 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] PATH_INFO: `/v3/users/af3e886d442c4d14b8233c0abef0120a` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:01.469793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3e886d442c4d14b8233c0abef0120a)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:01.474312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:01.579129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3e886d442c4d14b8233c0abef0120a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.580646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3e886d442c4d14b8233c0abef0120a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.594480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3e886d442c4d14b8233c0abef0120a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.623855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3e886d442c4d14b8233c0abef0120a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.625455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3e886d442c4d14b8233c0abef0120a'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:01.663801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1052/2098] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:01 2022] DELETE /identity/v3/users/af3e886d442c4d14b8233c0abef0120a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:02.485636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:02.488217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:02.561634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2dc5a-67df-46d9-b9f6-542d8c1b3b89 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:02.771728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:02.772748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:02.773248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:02.773731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] PATH_INFO: `/v3/projects/d149870bdf994527bfcea8955d27488c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:02.776861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d149870bdf994527bfcea8955d27488c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:02.782268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:02.893933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd149870bdf994527bfcea8955d27488c', 'request_id': 'req-007c2160-dd54-4b57-898a-ae9d0b023372'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:02.938853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd149870bdf994527bfcea8955d27488c', 'request_id': 'req-007c2160-dd54-4b57-898a-ae9d0b023372'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:02.966542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd149870bdf994527bfcea8955d27488c', 'request_id': 'req-007c2160-dd54-4b57-898a-ae9d0b023372'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:03.001333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] The token cache is being invalidate because project d149870bdf994527bfcea8955d27488c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:03.003018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:03.004834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-007c2160-dd54-4b57-898a-ae9d0b023372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:03.009587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1047/2099] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:02 2022] DELETE /identity/v3/projects/d149870bdf994527bfcea8955d27488c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:03.992883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:03.992883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:04.000868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053f3a-9ca5-4a8e-8e26-a81ae34e2807 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:04.060527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:04.134498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:04.135202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.135492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.135767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] PATH_INFO: `/v3/users/d75237bf836149b6b08d8d63b821f0dd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.137217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75237bf836149b6b08d8d63b821f0dd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:04.139406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:04.254975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75237bf836149b6b08d8d63b821f0dd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:04.256401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75237bf836149b6b08d8d63b821f0dd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:04.273420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75237bf836149b6b08d8d63b821f0dd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:04.306475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75237bf836149b6b08d8d63b821f0dd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:04.307423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5b027f2d-dbb3-4222-8412-2bb801b2d96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75237bf836149b6b08d8d63b821f0dd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:04.355051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1053/2100] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:03 2022] DELETE /identity/v3/users/d75237bf836149b6b08d8d63b821f0dd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:04.357151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.357624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.357715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.384352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.385212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.385892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.399149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:04.403062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:04.460093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:04.463514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] MFA Rules not processed for user `1b765b23cd2140979234a96624e57492`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:04.465413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:04.568460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1048/2101] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:04.575783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1054/2102] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:04.583396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:04.585232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:04.587383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:04.589731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:04.619088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191a420-8413-4223-a6f4-9b92dcedf041 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:04.628096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:04.629058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.629666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.630170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.631422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:04.636549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:04.697074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1055/2103] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:04 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:04.702934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:04.735198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4d411-d74d-476d-b6d7-8c455fd35161 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:04.785401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:04.916448 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065ce45-61b3-4c7f-aa26-10c5145672f9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:04.924947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:04.926504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.927108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.927672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.941137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:04.941953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:04.942261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:04.942724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:04.943396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:04.946087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:04.948881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:04.953776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:04.977563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1049/2104] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:05.047464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1056/2105] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:04 2022] POST /identity/v3/users => generated 299 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:05.049898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:05.075448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcceb9-12c3-48fd-85f0-d3949c47b266 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:05.103759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:05.104885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.105444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.105995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.107250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:05.118697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:05.159335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1050/2106] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:05.164118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:05.176803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7db7c-d023-4935-b24c-9810eb4facc4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:05.187176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:05.188010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.188299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.188581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] PATH_INFO: `/v3/projects/f39d4cd746134a018bf2003c38aae63f/users/92be39213df84e55a433919f8279d652/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.222613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39d4cd746134a018bf2003c38aae63f, user_id=92be39213df84e55a433919f8279d652, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:05.226618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:05.260837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1057/2107] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:05 2022] PUT /identity/v3/projects/f39d4cd746134a018bf2003c38aae63f/users/92be39213df84e55a433919f8279d652/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:05.262066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:05.282227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10f66-d3e8-42bb-975e-784a071d8759 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:05.401169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:05.401820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.402000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.402499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.403182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:05.405327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:05.417473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1051/2108] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:05.426382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:05.460321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829c1c-5b53-4c8f-835c-8327fd77a2e5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:05.469568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:05.471435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.472155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.472677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] PATH_INFO: `/v3/projects/f39d4cd746134a018bf2003c38aae63f/users/92be39213df84e55a433919f8279d652/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.476225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39d4cd746134a018bf2003c38aae63f, user_id=92be39213df84e55a433919f8279d652, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:05.480681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30894f-b726-4e1a-bb9a-a479bffd4260 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:05.500304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1058/2109] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:05 2022] PUT /identity/v3/projects/f39d4cd746134a018bf2003c38aae63f/users/92be39213df84e55a433919f8279d652/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:05.589836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:05.591862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:05.606610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac43bd-0083-4eb3-8a49-ed0668b77bfb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:05.611786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:05.707116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:05.708378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.708853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.709328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] PATH_INFO: `/v3/projects/e793cca35be34d0d923301f9b249dc8a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.711971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e793cca35be34d0d923301f9b249dc8a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:05.715991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:05.804147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e793cca35be34d0d923301f9b249dc8a', 'request_id': 'req-9c720498-b4fc-4801-9b03-6adec1b923a7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:05.815726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e793cca35be34d0d923301f9b249dc8a', 'request_id': 'req-9c720498-b4fc-4801-9b03-6adec1b923a7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:05.830467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e793cca35be34d0d923301f9b249dc8a', 'request_id': 'req-9c720498-b4fc-4801-9b03-6adec1b923a7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:05.851967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] The token cache is being invalidate because project e793cca35be34d0d923301f9b249dc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:05.852492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:05.853707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c720498-b4fc-4801-9b03-6adec1b923a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:05.857247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1052/2110] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:05 2022] DELETE /identity/v3/projects/e793cca35be34d0d923301f9b249dc8a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:05.867108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:05.867421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:05.867849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:05.899864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:05.901191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:06.001883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1059/2111] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:06.018449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.018728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.019007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.055108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:06.056496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:06.069144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1053/2112] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:06.075076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.092019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ad77-cf5b-4b45-bfe1-9c0571f3d167 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.099781 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.100568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.100859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.101019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.101612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:06.101913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.103996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.120389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1060/2113] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:08:06.127057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.145203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80833d0e-7049-4de1-b07f-fc3971ccb5a7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.153512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.154994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.155467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.155880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.157017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.161201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.218210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1054/2114] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:06 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:06.224150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.236699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab0647-acf7-44c6-b900-334fc58efb24 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.417770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:06.436831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.438841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.444808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.445898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.448109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.450721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.486340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1061/2115] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:06 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:06.494188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.507639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203eb-ce6d-4ebb-bba6-154b0e64f079 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.515159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.515996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.516278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.516549 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.518035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.522923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.543393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1055/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:06.549180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.592773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c37d0-65b0-4d36-89ee-56e8c93ea0f4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.609805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.610474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.610784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.611249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.612213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.618286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e697d-f839-4e31-b471-bb4aac67f1d0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.658746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1062/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:06.658974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:06.678733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78f4e-3e1c-4353-9b06-fe1a5fb4c537 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:06.715370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:06.716103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.716443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.717836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] PATH_INFO: `/v3/projects/b65fc58b3fc9493db6194c8c361a2da5/users/1476891c2cef4f47b5570f7b9349121d/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.760197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65fc58b3fc9493db6194c8c361a2da5, user_id=1476891c2cef4f47b5570f7b9349121d, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:06.773035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:06.831220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1056/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:06 2022] PUT /identity/v3/projects/b65fc58b3fc9493db6194c8c361a2da5/users/1476891c2cef4f47b5570f7b9349121d/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:06.838646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:06.839670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:06.840147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:06.875408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] MFA Rules not processed for user `1476891c2cef4f47b5570f7b9349121d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:06.877683 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:07.015450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1063/2119] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:07.024194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:07.098404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:07.169431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0bc7-2149-42b4-8a50-32cb86f3e9bf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:07.176842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:07.182793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:07.183184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:07.183662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:07.184386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:07.188031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:07.230856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1057/2120] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:07 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:07.238140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:07.267114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394652-b2e0-4430-bdff-13bc978de19e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:07.561896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:07.562943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:07.563457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:07.564612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:07.565982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:07.571523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:07.692593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1064/2121] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:07 2022] POST /identity/v3/users => generated 300 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:07.697112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:07.727220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ea3c0-7342-4f4e-b7bf-f9e27a9a6d06 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:07.746137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:07.747219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:07.747874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:07.748172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:07.749254 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:07.756493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:07.819926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1058/2122] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:07.823371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:07.870146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff84bc3-a3f4-4fd9-8768-b892981cded8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:07.882527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:07.883990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:07.884491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:07.884997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] PATH_INFO: `/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d/users/bcab1d18b1fc439b995b89477ba56f42/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:07.936339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad9d142bc7945a5b2ff776b6d7c681d, user_id=bcab1d18b1fc439b995b89477ba56f42, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:07.944097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:07.989458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1065/2123] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:07 2022] PUT /identity/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d/users/bcab1d18b1fc439b995b89477ba56f42/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:07.994357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:08.025932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e1d0-7225-41dc-84b3-3404377fa848 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:08.239098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:08.240275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:08.240756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:08.241255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:08.243431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:08.248426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff431cf-0da5-474a-aacd-0cc104252751 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:08.293461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1059/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:08.300539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:08.330987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb786-ea32-40de-aad6-8b850dd5edb8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:08.349192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:08.351280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:08.352243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:08.352890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] PATH_INFO: `/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d/users/bcab1d18b1fc439b995b89477ba56f42/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:08.363030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad9d142bc7945a5b2ff776b6d7c681d, user_id=bcab1d18b1fc439b995b89477ba56f42, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:08.388390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:08.419821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1066/2125] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:08 2022] PUT /identity/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d/users/bcab1d18b1fc439b995b89477ba56f42/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:08.439376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:08.440053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:08.443808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:08.583299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] MFA Rules not processed for user `bcab1d18b1fc439b995b89477ba56f42`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:08.585860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:08.854303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1060/2126] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:08.870765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:08.890298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:08.919188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:09.016558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42851070-2261-43c6-9f1f-451fe4678971 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:09.022941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:09.024709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:09.025297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:09.025799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:09.039745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:09.042467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b0a6-6c11-4130-97d2-ff80b0b5336c service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:09.088802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1067/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:09.148099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:09.245583 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:09.343281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05095b-72e9-491b-a500-133f720f1b0d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:09.356409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:09.357896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:09.358533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:09.359160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] PATH_INFO: `/v3/users/1476891c2cef4f47b5570f7b9349121d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:09.361978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1476891c2cef4f47b5570f7b9349121d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:09.367154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:09.554186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1476891c2cef4f47b5570f7b9349121d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:09.555013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1476891c2cef4f47b5570f7b9349121d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:09.565441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1476891c2cef4f47b5570f7b9349121d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:09.599372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1476891c2cef4f47b5570f7b9349121d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:09.601125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1476891c2cef4f47b5570f7b9349121d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:09.650205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1061/2128] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:09 2022] DELETE /identity/v3/users/1476891c2cef4f47b5570f7b9349121d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:09.655625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:09.656368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:09.656368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:09.687409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:09.689430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:09.832516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1068/2129] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:09.833426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:09.835024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:09.936136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4421-a355-46d8-ab15-7cdea2106fc3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:09.944238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:09.944887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:09.945168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:09.945445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:09.962368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:09.964268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:10.006536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1062/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:10.653382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:10.655431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:10.684324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862c5c-1823-4766-afea-c603d8bdb45f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:10.702477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:10.702477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:10.702477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:10.702477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] PATH_INFO: `/v3/projects/b65fc58b3fc9493db6194c8c361a2da5` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:10.703213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65fc58b3fc9493db6194c8c361a2da5)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:10.703213 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:10.846851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65fc58b3fc9493db6194c8c361a2da5', 'request_id': 'req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:10.866530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65fc58b3fc9493db6194c8c361a2da5', 'request_id': 'req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:10.878226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65fc58b3fc9493db6194c8c361a2da5', 'request_id': 'req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:10.893655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] The token cache is being invalidate because project b65fc58b3fc9493db6194c8c361a2da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:10.894010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:10.895287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:10.900236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1069/2131] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:10 2022] DELETE /identity/v3/projects/b65fc58b3fc9493db6194c8c361a2da5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:10.901328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:10.917214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3859-30ef-4030-9ee9-4ba3873e4410 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:11.054393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:11.104269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:11.105207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:11.105497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:11.106815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] PATH_INFO: `/v3/users/bcab1d18b1fc439b995b89477ba56f42` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:11.112024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcab1d18b1fc439b995b89477ba56f42)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:11.114186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:11.295500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcab1d18b1fc439b995b89477ba56f42'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:11.296928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcab1d18b1fc439b995b89477ba56f42'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:11.313372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcab1d18b1fc439b995b89477ba56f42'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:11.365194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcab1d18b1fc439b995b89477ba56f42'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:11.366480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-254a70a9-8e1f-4c90-b4da-30c3143d590b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcab1d18b1fc439b995b89477ba56f42'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:11.400518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1063/2132] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:10 2022] DELETE /identity/v3/users/bcab1d18b1fc439b995b89477ba56f42 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:12.565147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:12.569204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:12.603369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa5f2-d598-4b5b-8af8-d15b7a037ec7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:12.715209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:12.778111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:12.780287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:12.781663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:12.782965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] PATH_INFO: `/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:12.785826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad9d142bc7945a5b2ff776b6d7c681d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:12.788777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:12.859814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad9d142bc7945a5b2ff776b6d7c681d', 'request_id': 'req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:12.880197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad9d142bc7945a5b2ff776b6d7c681d', 'request_id': 'req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:12.889228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad9d142bc7945a5b2ff776b6d7c681d', 'request_id': 'req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:12.904661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] The token cache is being invalidate because project 3ad9d142bc7945a5b2ff776b6d7c681d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:12.904983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:12.906972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d6aeb722-9af5-4c0a-9b6e-5697c0b1604b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:12.913312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1070/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:12 2022] DELETE /identity/v3/projects/3ad9d142bc7945a5b2ff776b6d7c681d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:12.921215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:12.921215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:12.921215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:12.953158 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:12.955095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:13.126999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1064/2134] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:13.137653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.139078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.139423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.244631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:13.248385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:13.311000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1071/2135] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:13.316647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.356637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810216dd-6138-4ec3-9b8c-432a3957dcc1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.379208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.379725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.380003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.380342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.380952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:13.381260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.383628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:13.437311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1065/2136] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:08:13.437586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.456129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859db4d-96be-410d-bdf1-8f35521bca21 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.472140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.472553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.473099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.474293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.475058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.484743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:13.527482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1072/2137] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:13 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:13.532224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.560829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bffe-e443-4d89-b308-c7e9613ba1ec admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.661860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:13.706509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.707685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.708279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.708915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.710228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.722663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:13.759040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1066/2138] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:13 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:13.765857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.802464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda03c0-3106-443a-bcad-a3d807e3f279 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.816557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.817644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.818152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.818667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.819868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.828082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:13.848005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1073/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:13.853162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.868188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ecb82-b3fb-472d-b3cd-b09f12b00ff7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.876122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.877919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.878273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.878727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.879636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.887293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b7109-841d-46ec-a4ae-5173c0eb5932 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:13.904613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1067/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:13.910792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:13.923508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae6bc3-3abc-485d-a118-1d3b18767478 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:13.935791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:13.938293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:13.940047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:13.940881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] PATH_INFO: `/v3/projects/4ebb5a63a18a4526a2491948ce0201b6/users/75d370a0bd104efc8fd053ed1f43ad84/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:13.988294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebb5a63a18a4526a2491948ce0201b6, user_id=75d370a0bd104efc8fd053ed1f43ad84, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:13.994076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:14.035357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1074/2141] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:13 2022] PUT /identity/v3/projects/4ebb5a63a18a4526a2491948ce0201b6/users/75d370a0bd104efc8fd053ed1f43ad84/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:14.050387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:14.051126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:14.051126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:14.107275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] MFA Rules not processed for user `75d370a0bd104efc8fd053ed1f43ad84`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:14.109290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:14.301561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1068/2142] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:14.308463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:14.549418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca507-f4b8-4c9c-b513-7edb0a285327 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:14.576685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:14.577325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:14.577608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:14.577883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:14.578575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:14.580876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693f6f-f9d5-4fe6-8449-4a6689fd1f5d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:14.623328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:14.669816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1075/2143] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:14 2022] POST /identity/v3/projects => generated 379 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:14.671936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:14.685876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f463ec-bf41-4b39-9672-f87653f1dbb2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:14.867785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:14.869422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:14.869718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:14.869972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:14.873012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:14.875314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:14.923824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1069/2144] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:14 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:14.926844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:14.927357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:14.927522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:14.929696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:14.942458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d6ab-ef2b-4bc4-aeb8-30db4f089e53 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:14.953428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:14.954939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:14.955444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:14.955957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:14.958943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:14.962833 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:14.967825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] MFA Rules not processed for user `92be39213df84e55a433919f8279d652`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:14.969189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:14.995793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1070/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:15.001328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.019273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1f38-9396-407f-8d85-d48933adbd61 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.034790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.036960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.037478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.038271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] PATH_INFO: `/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70/users/a7e95816a0e145e98026428e9b438faf/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.080996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4abeb10e924d01bf5b2a3409ebfa70, user_id=a7e95816a0e145e98026428e9b438faf, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:15.084722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:15.096282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1076/2146] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:15.121789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.124508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.154308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1071/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:14 2022] PUT /identity/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70/users/a7e95816a0e145e98026428e9b438faf/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:15.158801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.203624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:15.224511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a33a-1eb3-4b3c-a072-44595b740d5e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.265563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdf9-d627-4ec7-9fba-6ab53d21a390 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.270845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.271487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.271765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.272042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.272712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:15.274474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:15.290593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1072/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:15.294849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.301343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.302368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.302824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.303261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.305931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.310896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb70-a997-4122-b624-6a91bcd19969 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.316733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.317421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.317699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.318043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] PATH_INFO: `/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70/users/a7e95816a0e145e98026428e9b438faf/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.320793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4abeb10e924d01bf5b2a3409ebfa70, user_id=a7e95816a0e145e98026428e9b438faf, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:15.325541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b3f9-ece6-4e3e-a095-23f42d2d4401 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:15.345937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1073/2149] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:15 2022] PUT /identity/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70/users/a7e95816a0e145e98026428e9b438faf/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:15.358074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20b3-5042-4d5f-8f8d-a85499207db7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.358709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20b3-5042-4d5f-8f8d-a85499207db7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.360005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20b3-5042-4d5f-8f8d-a85499207db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.394931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:15.401812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a4ee20b3-5042-4d5f-8f8d-a85499207db7 None None] MFA Rules not processed for user `a7e95816a0e145e98026428e9b438faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:15.403568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a4ee20b3-5042-4d5f-8f8d-a85499207db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.419816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:15.422551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:15.441054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1077/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:08:15.538294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1074/2151] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:15.551726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.554053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.622712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.623220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.623553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.655934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:15.657460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.664986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c09-01d8-472d-bb42-cc5d1e0c87c8 service glance] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.760147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1075/2152] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:08:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:15.762474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.763366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.763777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.764201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:15.816269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:15.818001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:15.846490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:15.848365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:15.859874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1078/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:15.894883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:15.978147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710a973-88a8-471e-8714-1d21d8b67686 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:15.989969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:15.992299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:15.992299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:15.992299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:16.011075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:16.014633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:16.031828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1076/2154] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:08:19.081513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:19.093313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:19.114335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2865-9b09-4c78-a402-7f6c7773053e service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:19.127497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:19.128809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:19.130353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:19.130994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:19.156090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:19.159636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628743ad-ca6d-4c8e-869c-8931edf2a4b6 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:19.187926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1079/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:24.343681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:24.432277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49739-0e7a-4d57-9fc5-588c5d40d490 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:24.439311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:24.441080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:24.441967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:24.442809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] PATH_INFO: `/v3/users/75d370a0bd104efc8fd053ed1f43ad84` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:24.445360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d370a0bd104efc8fd053ed1f43ad84)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:24.449174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:24.534767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d370a0bd104efc8fd053ed1f43ad84'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:24.535617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d370a0bd104efc8fd053ed1f43ad84'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:24.545442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d370a0bd104efc8fd053ed1f43ad84'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:24.563856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d370a0bd104efc8fd053ed1f43ad84'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:24.565495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d370a0bd104efc8fd053ed1f43ad84'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:24.590310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1077/2156] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:24 2022] DELETE /identity/v3/users/75d370a0bd104efc8fd053ed1f43ad84 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:24.597741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:24.598359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:24.598780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:24.625612 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:24.627585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:24.748522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:24.822871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1080/2157] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:24.841392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:24.843418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:24.930867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:24.953260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b59d2-bca9-4b1a-a544-f1ebe1de2aa9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:24.962844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:24.964207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:24.964700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:24.965203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:24.987862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:24.990831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:25.022364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1078/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:25.595859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:25.598224 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:25.631471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a9ce-5b49-4420-8978-4ec5f4edd5a4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:25.638528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:25.639314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:25.639664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:25.640020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] PATH_INFO: `/v3/projects/4ebb5a63a18a4526a2491948ce0201b6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:25.642225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebb5a63a18a4526a2491948ce0201b6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:25.644710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:25.738603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebb5a63a18a4526a2491948ce0201b6', 'request_id': 'req-09bd3010-5f96-4a00-9607-940efe7a2c3e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:25.756673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebb5a63a18a4526a2491948ce0201b6', 'request_id': 'req-09bd3010-5f96-4a00-9607-940efe7a2c3e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:25.788190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebb5a63a18a4526a2491948ce0201b6', 'request_id': 'req-09bd3010-5f96-4a00-9607-940efe7a2c3e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:25.826404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] The token cache is being invalidate because project 4ebb5a63a18a4526a2491948ce0201b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:25.833325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:25.835817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:25.839411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1081/2159] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:25 2022] DELETE /identity/v3/projects/4ebb5a63a18a4526a2491948ce0201b6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:25.845991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:25.883907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8cf5a-4447-4100-ae80-d101cf0dacfc service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:26.027339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:26.028930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:26.029415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:26.029900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] PATH_INFO: `/v3/users/a7e95816a0e145e98026428e9b438faf` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:26.032290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e95816a0e145e98026428e9b438faf)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:26.036010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:26.151718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e95816a0e145e98026428e9b438faf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:26.152710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e95816a0e145e98026428e9b438faf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:26.169502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e95816a0e145e98026428e9b438faf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:26.211475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e95816a0e145e98026428e9b438faf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:26.214950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c612a72e-ce52-4728-b52f-9d0a3094d997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e95816a0e145e98026428e9b438faf'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:26.282829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1079/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:25 2022] DELETE /identity/v3/users/a7e95816a0e145e98026428e9b438faf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:27.072368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:27.074951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:27.103082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd3010-5f96-4a00-9607-940efe7a2c3e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:27.275815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:27.276936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:27.278147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:27.278833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] PATH_INFO: `/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:27.286927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4abeb10e924d01bf5b2a3409ebfa70)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:27.293110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:27.430178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4abeb10e924d01bf5b2a3409ebfa70', 'request_id': 'req-144e1e01-e600-455c-a565-3983b569b279'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:27.449546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4abeb10e924d01bf5b2a3409ebfa70', 'request_id': 'req-144e1e01-e600-455c-a565-3983b569b279'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:27.461099 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4abeb10e924d01bf5b2a3409ebfa70', 'request_id': 'req-144e1e01-e600-455c-a565-3983b569b279'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:27.473809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:27.479602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] The token cache is being invalidate because project 8c4abeb10e924d01bf5b2a3409ebfa70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:27.481038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:27.482763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-144e1e01-e600-455c-a565-3983b569b279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:27.485532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1082/2161] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:27 2022] DELETE /identity/v3/projects/8c4abeb10e924d01bf5b2a3409ebfa70 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:27.497989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:27.498730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:27.499016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:27.569389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:27.571014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:27.660460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1080/2162] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:27.674489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:27.674995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:27.675550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:27.719307 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:27.721477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:27.736059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1083/2163] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:27.742650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:27.749427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:27.757544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68be2-cc23-4537-9fa0-fb239fa352d8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:27.770002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:27.770758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:27.771146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:27.771514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:27.772161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:27.773264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:27.777119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:27.805401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1081/2164] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:08:27.810609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:27.833554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f62b1-1862-433a-a316-d2a70ca348a1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:27.841523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:27.842476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:27.842698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:27.843043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:27.843831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:27.848784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:27.899711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1084/2165] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:27 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:27.907747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:27.921097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b7247-6a11-4298-87ba-ed2e9224ace7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.001999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.003176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.003176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.003390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.003921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.006924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.039476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1082/2166] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:27 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:28.046362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.059385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26b33-02d2-48f4-bcbc-a31a5dd94765 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.066297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.070427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.070427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.070427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.070427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.071916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.084168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1085/2167] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:28.088804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.100470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c7cc-8370-418a-949e-a611c5e2c402 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.109826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.111022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.111299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.111566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.112930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.114608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81544-47e5-4326-9f81-330c8c8eea57 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.134387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1083/2168] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:28.139828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.151196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7703-a30e-45d6-9877-cd0eddddbe12 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.157222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.158388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.158672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.158949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] PATH_INFO: `/v3/projects/21c7323ca2ac4810a5ecce42bca299e4/users/10ca86508cad4f4185576aa0b12939e6/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.188877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7323ca2ac4810a5ecce42bca299e4, user_id=10ca86508cad4f4185576aa0b12939e6, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.194908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.220066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1086/2169] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:28 2022] PUT /identity/v3/projects/21c7323ca2ac4810a5ecce42bca299e4/users/10ca86508cad4f4185576aa0b12939e6/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:28.237613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.238113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.238542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.281554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] MFA Rules not processed for user `10ca86508cad4f4185576aa0b12939e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:28.290019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:28.464742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1084/2170] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:28.488323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.637172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4067d7-4c57-4fbf-9ba3-814ff859ba35 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.645041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.645041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.645041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.645041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.650437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.654089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.705269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1087/2171] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:28 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:28.707477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.730537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2917-3b0b-4797-b877-dc2839548fdf None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.863260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.863944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.864293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.864648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.865493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.867562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.888487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:28.933209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1085/2172] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:28 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:28.937508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.949499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c2e8a-fc6a-4f7a-acb9-2558d5f781f7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:28.955750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:28.956391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:28.956674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:28.956951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:28.958887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:28.959350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:28.976204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1088/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:28.977488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:28.996285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729389-19ba-4435-aa0b-dbe6055a9c7e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.009462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.010830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.011650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.012171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.013030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.014998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b7c5-49d0-4d50-a0ec-3fcfa9c57047 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.038370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1086/2174] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:29.040657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.053126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab18a9a-7b22-4dd5-aac2-91c2a4e561d0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.058945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.060081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.060479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.060928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] PATH_INFO: `/v3/projects/dae5113c578f45738deba6f985a344f3/users/eed9a7d268a64b5aa2727072a96fd305/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.086795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae5113c578f45738deba6f985a344f3, user_id=eed9a7d268a64b5aa2727072a96fd305, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.091853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.111991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1089/2175] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:29 2022] PUT /identity/v3/projects/dae5113c578f45738deba6f985a344f3/users/eed9a7d268a64b5aa2727072a96fd305/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:29.126997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.127671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.128012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.167662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] MFA Rules not processed for user `eed9a7d268a64b5aa2727072a96fd305`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:29.169050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:29.281465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1087/2176] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:29.287931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.365149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:29.401704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d7997-acf0-4918-a3be-1fb48ed07f93 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.410078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.411045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.411427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.411805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.413315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.416001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24cec-69fa-4812-96da-264115c2722a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.455187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1090/2177] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:29 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:29.459891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.482217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9157bc-2f33-465b-8565-b33a2526204f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.497034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.497315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.497595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.519181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] MFA Rules not processed for user `1b765b23cd2140979234a96624e57492`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:29.520512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:29.569910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.570913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.571333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.571776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.572914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.576100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.609215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1091/2178] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:29.610091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1088/2179] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:29 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:29.617073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.637811 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83eabf-4b61-442c-9baf-65d5587facc4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.644835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.645482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.645886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.646167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.647048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.648759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.661189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1092/2180] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:29.668411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.684280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823fee-2858-4ee9-87a5-9fe4f1321074 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.689526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.690214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.690538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.690810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] PATH_INFO: `/v3/projects/5696dd20cbb74d2baab7b668f33de9aa/users/05e4bcd9cb2a4afeafcafe9b26550ccd/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.723245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5696dd20cbb74d2baab7b668f33de9aa, user_id=05e4bcd9cb2a4afeafcafe9b26550ccd, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.727105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.754205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1089/2181] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:29 2022] PUT /identity/v3/projects/5696dd20cbb74d2baab7b668f33de9aa/users/05e4bcd9cb2a4afeafcafe9b26550ccd/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:29.759293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.772664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b179b-25cb-4b51-9650-503a9660bd41 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.886953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.887614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.887977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.888190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.888906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.890753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac996-a4b2-405e-8ff0-424926ec474c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.903760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1093/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:29.908376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:29.922610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9075-ac6e-435e-87f9-e06ab92ff652 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:29.930472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:29.931985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.932677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.933634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] PATH_INFO: `/v3/projects/5696dd20cbb74d2baab7b668f33de9aa/users/05e4bcd9cb2a4afeafcafe9b26550ccd/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:29.939783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5696dd20cbb74d2baab7b668f33de9aa, user_id=05e4bcd9cb2a4afeafcafe9b26550ccd, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:29.945561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:29.974974 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1090/2183] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:29 2022] PUT /identity/v3/projects/5696dd20cbb74d2baab7b668f33de9aa/users/05e4bcd9cb2a4afeafcafe9b26550ccd/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:29.987162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:29.987494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:29.987852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:30.034510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] MFA Rules not processed for user `05e4bcd9cb2a4afeafcafe9b26550ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:30.035924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:30.109806 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:30.159789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1094/2184] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:30.172289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:30.175973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:30.223978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:30.299148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a4acd-4bfc-4099-8138-eca68de90493 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:30.303651 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:30.304325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:30.304668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:30.304933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:30.317736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:30.319678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:30.331982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1091/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:31.258380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:31.261008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:31.278911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64417a-d4c3-4768-87e3-445af829d64d None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:31.282784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:31.283446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:31.283721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:31.283992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:31.394209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:31.397046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f786b8-432c-47c1-9be8-17a12948b424 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:31.415552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1095/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:32.140963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:32.142784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:32.234502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9245ec-b7c5-49ef-972d-cb65a715a39a service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:32.242082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:32.243245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:32.243729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:32.244207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] PATH_INFO: `/v3/users/648e71a91fb6405c8195fab36d580e00` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:32.245809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648e71a91fb6405c8195fab36d580e00)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:32.248329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:32.314650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648e71a91fb6405c8195fab36d580e00'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:32.315654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648e71a91fb6405c8195fab36d580e00'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:32.325428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648e71a91fb6405c8195fab36d580e00'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:32.339816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648e71a91fb6405c8195fab36d580e00'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:32.340617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648e71a91fb6405c8195fab36d580e00'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:32.375021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db509-86c6-431a-ae0c-24a555c9efc6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:32.375645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db509-86c6-431a-ae0c-24a555c9efc6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:32.376055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719db509-86c6-431a-ae0c-24a555c9efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:32.381295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1092/2187] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:32 2022] DELETE /identity/v3/users/648e71a91fb6405c8195fab36d580e00 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:32.420103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-719db509-86c6-431a-ae0c-24a555c9efc6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:32.421570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-719db509-86c6-431a-ae0c-24a555c9efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:32.536504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1096/2188] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:32.547922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:32.549484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:32.659543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:32.680063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fef44-dad2-4e16-80a3-37d8e6e0cbb5 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:32.687247 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:32.688402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:32.689153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:32.689602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:32.710766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:32.713447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:32.729810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1093/2189] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:32.773000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:32.773644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:32.774102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:32.797592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:32.798967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:32.955251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1097/2190] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:32.956340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:32.957954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:33.118587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e660-8e4d-42dc-a30f-1d73966645e8 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:33.169018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:33.175131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:33.175131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:33.175131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:33.203120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:33.207615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691af0e-f971-4704-b149-0ec59e0975cb service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:33.242349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1094/2191] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:08:33.419552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:33.421774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:33.499941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85505a33-4a72-4678-b9a1-27ed238d4bff None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:33.545759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:33.546753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:33.547258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:33.548310 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] PATH_INFO: `/v3/projects/849fc1f867324835aeab6284d4ae02c3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:33.564680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849fc1f867324835aeab6284d4ae02c3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:33.568110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:33.687707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:33.735646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849fc1f867324835aeab6284d4ae02c3', 'request_id': 'req-f1548641-e445-4238-8ce0-d2a7d84d2290'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:33.754123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849fc1f867324835aeab6284d4ae02c3', 'request_id': 'req-f1548641-e445-4238-8ce0-d2a7d84d2290'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:33.768331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849fc1f867324835aeab6284d4ae02c3', 'request_id': 'req-f1548641-e445-4238-8ce0-d2a7d84d2290'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:33.805592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] The token cache is being invalidate because project 849fc1f867324835aeab6284d4ae02c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:33.805938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:33.810411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f1548641-e445-4238-8ce0-d2a7d84d2290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:33.824637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1098/2192] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:33 2022] DELETE /identity/v3/projects/849fc1f867324835aeab6284d4ae02c3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:33.847352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:33.850723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:33.851062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:33.884527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:33.885798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:34.027147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1095/2193] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:34.036585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.037150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.037755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.069950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:34.071600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:34.084964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1099/2194] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:34.086820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.105889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106af3-4679-4680-b0d4-1a7018af5169 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.115542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.116991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.117556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.118113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.120017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:34.120682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.123868 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:34.159131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1096/2195] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:08:34.163842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.181376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721877e0-33f4-4a60-91f1-52b72522f763 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.192231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.193613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.194182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.194990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.196031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.198984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:34.317611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1100/2196] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:34 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:34.324435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.352190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e00d-f465-4740-b9e0-7410fd83a447 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.580185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.581587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.582381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.583361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.584812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.589453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:34.613120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:34.654075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1097/2197] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:34 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:34.661521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.696697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb944d-e1eb-428d-bf73-107ecff621c1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.720316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.721439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.723403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.723705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.725333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.728540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:34.767058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1101/2198] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:34.774122 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.824141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fa49-20c6-4fbc-9a9c-4ddafefd8f69 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.838335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.839330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.839686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.840089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.840857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.843636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea5b85-0f77-44f6-9563-4879e2461672 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:34.873975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1098/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:34.880514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:34.908119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4c0c-c949-42fe-9dbd-ce085767639e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:34.923722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:34.925100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:34.925563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:34.926272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] PATH_INFO: `/v3/projects/54544b0cf65d47258a6faf3f7fcd84e3/users/073560b7f46644faa58f61ee82c9fe3c/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:34.963477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54544b0cf65d47258a6faf3f7fcd84e3, user_id=073560b7f46644faa58f61ee82c9fe3c, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:34.970620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:35.003101 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1102/2200] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:34 2022] PUT /identity/v3/projects/54544b0cf65d47258a6faf3f7fcd84e3/users/073560b7f46644faa58f61ee82c9fe3c/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:35.019655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:35.020119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:35.020593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:35.109911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] MFA Rules not processed for user `073560b7f46644faa58f61ee82c9fe3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:35.112323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:35.326751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1099/2201] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:35.330567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:35.333286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:35.423263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de39234-2088-42b4-ba98-010576b53c3a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:35.428069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:35.428886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:35.429375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:35.429852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:35.444269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:35.446064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:35.464293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1103/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:36.512235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:36.515728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:36.539475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10c1a5-b13c-4510-b663-4e98ac909398 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:36.543699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:36.544346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:36.544626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:36.545001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:36.546932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:36.633960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:36.635592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280a56-e254-43c2-81ed-c1b81e2db443 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:36.646718 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1100/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:08:40.091000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:40.093127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:40.181958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:40.201331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e2e2-2f89-4b54-9fc3-bfd0422cd516 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:40.215543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:40.216460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:40.216820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:40.217172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] PATH_INFO: `/v3/users/10ca86508cad4f4185576aa0b12939e6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:40.219979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ca86508cad4f4185576aa0b12939e6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:40.222579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:40.342367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ca86508cad4f4185576aa0b12939e6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:40.343408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ca86508cad4f4185576aa0b12939e6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:40.373520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ca86508cad4f4185576aa0b12939e6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:40.417971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ca86508cad4f4185576aa0b12939e6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:40.422709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ca86508cad4f4185576aa0b12939e6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:40.464574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1104/2204] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:40 2022] DELETE /identity/v3/users/10ca86508cad4f4185576aa0b12939e6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:40.471420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:40.473136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:40.474149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:40.517820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:40.522329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:40.664213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1101/2205] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:40.679782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:40.681304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:40.769176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef61be3-65ce-4bcf-809f-d19a6440bf4f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:40.773538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:40.774233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:40.774545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:40.775020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:40.787711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:40.789414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:40.801425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1105/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:41.485333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:41.488032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:41.507371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783397c4-ab35-424f-81f4-7072afabc363 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:41.541205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:41.542300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:41.542760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:41.543214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] PATH_INFO: `/v3/projects/21c7323ca2ac4810a5ecce42bca299e4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:41.546499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c7323ca2ac4810a5ecce42bca299e4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:41.558293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:41.585307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:41.772654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c7323ca2ac4810a5ecce42bca299e4', 'request_id': 'req-9114ac91-087e-452b-bfba-8b3dfd543ed3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:41.815692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c7323ca2ac4810a5ecce42bca299e4', 'request_id': 'req-9114ac91-087e-452b-bfba-8b3dfd543ed3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:41.850386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c7323ca2ac4810a5ecce42bca299e4', 'request_id': 'req-9114ac91-087e-452b-bfba-8b3dfd543ed3'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:41.882360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] The token cache is being invalidate because project 21c7323ca2ac4810a5ecce42bca299e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:41.882839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:41.884010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:41.886291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1102/2207] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:41 2022] DELETE /identity/v3/projects/21c7323ca2ac4810a5ecce42bca299e4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:41.893586 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:41.932009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d833bd-d399-4c76-bcc8-d3e6acb40541 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:42.086547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:42.087451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:42.087742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:42.088073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] PATH_INFO: `/v3/users/eed9a7d268a64b5aa2727072a96fd305` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:42.090062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed9a7d268a64b5aa2727072a96fd305)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:42.092649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:42.129426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:42.211245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed9a7d268a64b5aa2727072a96fd305'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:42.213482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed9a7d268a64b5aa2727072a96fd305'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:42.247953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed9a7d268a64b5aa2727072a96fd305'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:42.273558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed9a7d268a64b5aa2727072a96fd305'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:42.274763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed9a7d268a64b5aa2727072a96fd305'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:42.312195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1106/2208] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:41 2022] DELETE /identity/v3/users/eed9a7d268a64b5aa2727072a96fd305 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:42.893320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:42.896940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:42.958928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ac91-087e-452b-bfba-8b3dfd543ed3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:43.174748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:43.175872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:43.190783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:43.191698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] PATH_INFO: `/v3/projects/dae5113c578f45738deba6f985a344f3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:43.194827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae5113c578f45738deba6f985a344f3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:43.198931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:43.354715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae5113c578f45738deba6f985a344f3', 'request_id': 'req-0baf27a4-658a-4377-9528-f3be13f9c947'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.366034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae5113c578f45738deba6f985a344f3', 'request_id': 'req-0baf27a4-658a-4377-9528-f3be13f9c947'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.390033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae5113c578f45738deba6f985a344f3', 'request_id': 'req-0baf27a4-658a-4377-9528-f3be13f9c947'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.440001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] The token cache is being invalidate because project dae5113c578f45738deba6f985a344f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:43.442036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.445591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.458031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:43.460503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:43.464469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1103/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:42 2022] DELETE /identity/v3/projects/dae5113c578f45738deba6f985a344f3 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:43.503413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27083f-5a4d-4497-983f-0ef809b2e7db admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:43.640562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:43.642904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:43.643317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:43.643695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] PATH_INFO: `/v3/users/05e4bcd9cb2a4afeafcafe9b26550ccd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:43.647149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e4bcd9cb2a4afeafcafe9b26550ccd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:43.663146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:43.777182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e4bcd9cb2a4afeafcafe9b26550ccd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.779629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e4bcd9cb2a4afeafcafe9b26550ccd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.798882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e4bcd9cb2a4afeafcafe9b26550ccd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.847364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e4bcd9cb2a4afeafcafe9b26550ccd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.848188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5776c7e9-93ca-421c-9b2c-360a32e45167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e4bcd9cb2a4afeafcafe9b26550ccd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:43.877461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1107/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:43 2022] DELETE /identity/v3/users/05e4bcd9cb2a4afeafcafe9b26550ccd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:44.997783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:44.999614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:45.035192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf27a4-658a-4377-9528-f3be13f9c947 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.068182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:45.128405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.129071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.129355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.129701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] PATH_INFO: `/v3/projects/5696dd20cbb74d2baab7b668f33de9aa` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.131056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5696dd20cbb74d2baab7b668f33de9aa)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.133269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.211345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5696dd20cbb74d2baab7b668f33de9aa', 'request_id': 'req-6db10491-1b62-4e3d-b2c4-1796a5acdc78'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:45.221519 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5696dd20cbb74d2baab7b668f33de9aa', 'request_id': 'req-6db10491-1b62-4e3d-b2c4-1796a5acdc78'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:45.235071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5696dd20cbb74d2baab7b668f33de9aa', 'request_id': 'req-6db10491-1b62-4e3d-b2c4-1796a5acdc78'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:45.252005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] The token cache is being invalidate because project 5696dd20cbb74d2baab7b668f33de9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:45.252464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:45.253311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-6db10491-1b62-4e3d-b2c4-1796a5acdc78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:45.255248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1104/2211] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:44 2022] DELETE /identity/v3/projects/5696dd20cbb74d2baab7b668f33de9aa => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:45.261671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.262436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.262436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.286123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:45.287520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:45.298330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:45.388464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1108/2212] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:45.399756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.400109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.400354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.425812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:45.427181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:45.436038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1105/2213] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:45.441173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.456896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16631-bf76-42e3-a24c-04965896f7f2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.462625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.463338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.463632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.463906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.465050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:45.465404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.467126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.482154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1109/2214] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:08:45.489442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.506771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4e683-17e2-472b-9305-1e571b2c2cf1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.513876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.514888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.515347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.516445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.517498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.522881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.571218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1106/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:45 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:45.577337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.590895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e561e10-abee-4330-9e3c-5aedd7d33ffc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.678497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.679253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.679653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.680023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.680787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.683669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.712428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1110/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:45 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:45.718066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.731748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c289-d12e-4a93-8f46-f5a3b7b8a9cb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.737800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.738646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.738959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.739357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.740187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.741971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.754551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1107/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:45.759827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.778829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4beb-3d38-4595-8254-bb2f40023079 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.787379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.788419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.788910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.789405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.790546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.793446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26160b-5cc2-4396-b3b7-30ff16c51955 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.814262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1111/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:45.818865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:45.830386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d4b5-4305-47c7-9533-a8c6b6696bf8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:45.835565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:45.836251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.836525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.836799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] PATH_INFO: `/v3/projects/dc5eb9eca7d642d18d2bf629cc9af9b6/users/b0f20f0d70024296b89cd8d9774cb25a/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.855129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5eb9eca7d642d18d2bf629cc9af9b6, user_id=b0f20f0d70024296b89cd8d9774cb25a, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:45.858518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:45.876679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1108/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:45 2022] PUT /identity/v3/projects/dc5eb9eca7d642d18d2bf629cc9af9b6/users/b0f20f0d70024296b89cd8d9774cb25a/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:45.891454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:45.891933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:45.892437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:45.945271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] MFA Rules not processed for user `b0f20f0d70024296b89cd8d9774cb25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:45.946631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:46.059226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1112/2220] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:46.077798 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.159786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:46.180250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec02bdd-5470-48bc-884e-417150e388ff admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.188272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.189243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.189617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.189901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.190741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.193023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.229497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1109/2221] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:46 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:46.235182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.254790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19f94f-404c-4ee5-b8c2-a91693913921 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.264194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:46.358462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.359106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.360095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.360473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.361254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.363575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.388567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1113/2222] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:46 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:46.394133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.405598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a523-5c66-4626-9dc4-dceb31a18e73 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.411915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.412679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.413058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.413424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.414346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.416053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.429995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1110/2223] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:46.434940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.446597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb7a3-0cad-4875-9bb2-33d8e44d55d8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.452058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.452756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.453036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.453832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] PATH_INFO: `/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6/users/fb2599c280fd48e0893f14da1effb29c/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.476422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6ae979c8b541acb24da7c4c57a27b6, user_id=fb2599c280fd48e0893f14da1effb29c, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.481718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.502897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1114/2224] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:46 2022] PUT /identity/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6/users/fb2599c280fd48e0893f14da1effb29c/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:46.508983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.522012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68ffb-ee10-4fbc-b058-96b0a5f1ead9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.610084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.611489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.612796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.613233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.614556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.617232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1962c2-1c66-48fb-afa0-7676343a41d7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.639869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1111/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:46.642072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.662427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e8d6-0fad-4844-90ca-daafa437feef admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.671152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.672845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.673332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.673662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] PATH_INFO: `/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6/users/fb2599c280fd48e0893f14da1effb29c/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.675985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6ae979c8b541acb24da7c4c57a27b6, user_id=fb2599c280fd48e0893f14da1effb29c, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.679028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.692456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1115/2226] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:46 2022] PUT /identity/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6/users/fb2599c280fd48e0893f14da1effb29c/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:46.706674 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.707138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.707557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.750915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] MFA Rules not processed for user `fb2599c280fd48e0893f14da1effb29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:46.752930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:46.863797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1112/2227] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:46.875666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:46.878165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:46.957121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48d856-4a12-462b-8c6f-9e32f11dd5db admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:46.961331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:46.961978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:46.962320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:46.962563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:46.974216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:46.975988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ec11-8642-4925-85ff-fe14769fdefa service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:46.988557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1116/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:47.165377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:47.242272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:47.264332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904375-64e0-429a-bd1b-300e9bb8c9b1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:47.270075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:47.270945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:47.271227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:47.271508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] PATH_INFO: `/v3/users/b0f20f0d70024296b89cd8d9774cb25a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:47.272783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f20f0d70024296b89cd8d9774cb25a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:47.274802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:47.347388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f20f0d70024296b89cd8d9774cb25a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:47.348862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f20f0d70024296b89cd8d9774cb25a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:47.368568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f20f0d70024296b89cd8d9774cb25a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:47.398322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f20f0d70024296b89cd8d9774cb25a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:47.399288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f20f0d70024296b89cd8d9774cb25a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:47.426922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1113/2229] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:47 2022] DELETE /identity/v3/users/b0f20f0d70024296b89cd8d9774cb25a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:47.433857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:47.434790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:47.435040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:47.461076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:47.463371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:47.576696 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1117/2230] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:47.592312 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:47.595019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:47.735373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352424-b766-44ce-ae7a-b12ff3e0dc39 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:47.741866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:47.742963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:47.743550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:47.743999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:47.757276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:47.758887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:47.772028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1114/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:48.369027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:48.372407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:48.398920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:48.407136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362da43-6a84-437c-a183-0e68352d1f0f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:48.414977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:48.415856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:48.416232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:48.416601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] PATH_INFO: `/v3/projects/dc5eb9eca7d642d18d2bf629cc9af9b6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:48.418464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5eb9eca7d642d18d2bf629cc9af9b6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:48.421137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:48.502049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5eb9eca7d642d18d2bf629cc9af9b6', 'request_id': 'req-918496ea-5745-4e02-8145-372cc08858a8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.511897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5eb9eca7d642d18d2bf629cc9af9b6', 'request_id': 'req-918496ea-5745-4e02-8145-372cc08858a8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.520740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5eb9eca7d642d18d2bf629cc9af9b6', 'request_id': 'req-918496ea-5745-4e02-8145-372cc08858a8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.535721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] The token cache is being invalidate because project dc5eb9eca7d642d18d2bf629cc9af9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:48.536178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.536985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.538880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1118/2232] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:48 2022] DELETE /identity/v3/projects/dc5eb9eca7d642d18d2bf629cc9af9b6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:48.543750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:48.557776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09938157-e22a-4e7d-8031-f5f01a0a7295 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:48.666862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:48.667570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:48.667864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:48.668146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] PATH_INFO: `/v3/users/fb2599c280fd48e0893f14da1effb29c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:48.669554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2599c280fd48e0893f14da1effb29c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:48.671595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:48.678584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:48.748404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2599c280fd48e0893f14da1effb29c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.749149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2599c280fd48e0893f14da1effb29c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.758772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2599c280fd48e0893f14da1effb29c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.795391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2599c280fd48e0893f14da1effb29c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.797883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-01944896-bfbc-4995-ae1e-a411f6c2f842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2599c280fd48e0893f14da1effb29c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:48.834020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1115/2233] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:48 2022] DELETE /identity/v3/users/fb2599c280fd48e0893f14da1effb29c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:48.980594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:48.982804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.009037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918496ea-5745-4e02-8145-372cc08858a8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:49.098760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:49.099434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.099918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.100192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] PATH_INFO: `/v3/users/073560b7f46644faa58f61ee82c9fe3c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.101694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] RBAC: Authorizing `identity:delete_user(user_id=073560b7f46644faa58f61ee82c9fe3c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:49.103948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:49.183804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073560b7f46644faa58f61ee82c9fe3c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.184629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073560b7f46644faa58f61ee82c9fe3c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.195966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073560b7f46644faa58f61ee82c9fe3c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.216260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073560b7f46644faa58f61ee82c9fe3c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.217554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073560b7f46644faa58f61ee82c9fe3c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.270191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1119/2234] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:08:48 2022] DELETE /identity/v3/users/073560b7f46644faa58f61ee82c9fe3c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:49.270551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.270551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.270551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.318996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:49.321490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.399453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:49.401138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.414959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:49.441564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1116/2235] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:49.460140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:49.463330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.560816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c5a2-21ae-4ad4-84c2-5572b061323a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:49.569352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:49.570350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.570795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.571216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] PATH_INFO: `/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.572776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6ae979c8b541acb24da7c4c57a27b6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:49.576053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:49.581077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061430be-6cf6-4e10-b00b-c8d4f6a4c146 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:49.586799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:49.588326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.589328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.589860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.612298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:49.614189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b680-6a4d-4410-991e-504dc8103fd5 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:49.630865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1117/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:08:49.656177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6ae979c8b541acb24da7c4c57a27b6', 'request_id': 'req-9bb8d394-778b-4908-b613-bd75376d7c65'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.667575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6ae979c8b541acb24da7c4c57a27b6', 'request_id': 'req-9bb8d394-778b-4908-b613-bd75376d7c65'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.677867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6ae979c8b541acb24da7c4c57a27b6', 'request_id': 'req-9bb8d394-778b-4908-b613-bd75376d7c65'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.692353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] The token cache is being invalidate because project 4f6ae979c8b541acb24da7c4c57a27b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:49.692635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.693320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-9bb8d394-778b-4908-b613-bd75376d7c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:49.694988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1120/2237] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:49 2022] DELETE /identity/v3/projects/4f6ae979c8b541acb24da7c4c57a27b6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:49.701794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.702195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.702579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.726020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:49.727521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.757602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:49.817876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1118/2238] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:49.830352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.830926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.831381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.866481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:49.867723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:49.876278 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1121/2239] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:08:49.881679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:49.901843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ac16-ea2e-4dfc-ba1d-74521163d0de None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:49.909413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:49.910547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.911050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.911548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.912706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:08:49.913227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:49.916321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:49.940621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1119/2240] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:08:49.945455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:49.963588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5844b0c-b7ba-4aba-b24d-d07209d302b6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:49.973344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:49.974356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:49.974820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:49.975329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:49.976756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:49.979354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.031613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1122/2241] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:08:49 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:08:50.033652 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.053475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587a058-6d63-45d8-91c5-f0444c7d141b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.082930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.084728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:50.159308 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.160444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.161035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.161608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.162995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.167355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.188189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b51cd-c857-4ad0-8083-76b108f1908e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.193905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.194703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.194970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.195251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] PATH_INFO: `/v3/projects/54544b0cf65d47258a6faf3f7fcd84e3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.196644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54544b0cf65d47258a6faf3f7fcd84e3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.198832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.207542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1120/2242] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:08:50 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:08:50.213208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:50.213883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.233415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d1d6-bc71-4be1-afa7-521fa23beaf3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.241353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.242125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.242441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.242743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.243408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.245968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.266310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1121/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:08:50.270819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.282558 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54544b0cf65d47258a6faf3f7fcd84e3', 'request_id': 'req-13415dd9-0734-4bd7-ba68-de5ace160b41'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:50.293086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0033b5-6365-4853-9094-719ace05f142 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.300357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54544b0cf65d47258a6faf3f7fcd84e3', 'request_id': 'req-13415dd9-0734-4bd7-ba68-de5ace160b41'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:50.310809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54544b0cf65d47258a6faf3f7fcd84e3', 'request_id': 'req-13415dd9-0734-4bd7-ba68-de5ace160b41'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:50.325902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] The token cache is being invalidate because project 54544b0cf65d47258a6faf3f7fcd84e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:08:50.326220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:50.327571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:08:50.333903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1123/2244] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:08:50 2022] DELETE /identity/v3/projects/54544b0cf65d47258a6faf3f7fcd84e3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:08:50.426849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.428672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.429726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.430598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.432592 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.436350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722ab7-a9c2-4808-8d22-ca3f39e3491b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.472676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1122/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:08:50.478312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.480028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:50.499515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415dd9-0734-4bd7-ba68-de5ace160b41 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.506329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.508117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.508117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.520227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] PATH_INFO: `/v3/projects/c60b501dcdb04dbebecdc6b69d5042dc/users/5e56cf34c1774490bba15beb023eb88f/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.546546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60b501dcdb04dbebecdc6b69d5042dc, user_id=5e56cf34c1774490bba15beb023eb88f, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.550349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.570345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1124/2246] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:08:50 2022] PUT /identity/v3/projects/c60b501dcdb04dbebecdc6b69d5042dc/users/5e56cf34c1774490bba15beb023eb88f/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:08:50.581918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cba28-254b-4fae-8121-97dfca495248 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.582742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cba28-254b-4fae-8121-97dfca495248 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.582742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cba28-254b-4fae-8121-97dfca495248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.624861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e64cba28-254b-4fae-8121-97dfca495248 None None] MFA Rules not processed for user `5e56cf34c1774490bba15beb023eb88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:08:50.627631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e64cba28-254b-4fae-8121-97dfca495248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:50.673976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:08:50.769228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1123/2247] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:08:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:08:50.787867 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:08:50.790825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:08:50.913898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff188-5534-4237-ad59-48e442bf7874 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:08:50.919493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:08:50.920685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:08:50.921003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:08:50.921430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:08:50.933312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:08:50.934874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:08:50.946826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1125/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:08:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:00.762124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=18 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:00.940921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:04.471156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c201b-75d0-4c45-8733-60c70ee026f1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:04.471997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c201b-75d0-4c45-8733-60c70ee026f1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:04.472172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c201b-75d0-4c45-8733-60c70ee026f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:04.514563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-990c201b-75d0-4c45-8733-60c70ee026f1 None None] MFA Rules not processed for user `f0096ff6416148d4a75e70393efec73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:04.514563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-990c201b-75d0-4c45-8733-60c70ee026f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:04.602021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1124/2249] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:09:05.847630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:06.004002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb043-c7d5-4dbb-96cd-e2914c784342 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:06.017309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:06.017309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.017793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.017793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] PATH_INFO: `/v3/users/5e56cf34c1774490bba15beb023eb88f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:06.019497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e56cf34c1774490bba15beb023eb88f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:06.026849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:06.104359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e56cf34c1774490bba15beb023eb88f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.105073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e56cf34c1774490bba15beb023eb88f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.122495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e56cf34c1774490bba15beb023eb88f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.133968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e56cf34c1774490bba15beb023eb88f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.134846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e56cf34c1774490bba15beb023eb88f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.158759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1126/2250] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:09:05 2022] DELETE /identity/v3/users/5e56cf34c1774490bba15beb023eb88f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:09:06.165606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da950af-942c-422c-a705-72fc965420fe None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.165986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da950af-942c-422c-a705-72fc965420fe None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.166403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da950af-942c-422c-a705-72fc965420fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:06.188778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6da950af-942c-422c-a705-72fc965420fe None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:06.190207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6da950af-942c-422c-a705-72fc965420fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:06.262493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1125/2251] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:06.274529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:06.277067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:06.367504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21f055-53d2-4480-949d-6cf20441494e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:06.375545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:06.376180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.376579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.376770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:06.388395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:06.389922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:06.401549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1127/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:06.695421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da950af-942c-422c-a705-72fc965420fe None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:06.697265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6da950af-942c-422c-a705-72fc965420fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:06.805125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:06.807345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:06.837225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e11f7b-4ad3-4d47-8e3a-a8f3ec6f8d29 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:06.850434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da950af-942c-422c-a705-72fc965420fe None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:06.851751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:06.853736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.853736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.854092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] PATH_INFO: `/v3/projects/c60b501dcdb04dbebecdc6b69d5042dc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:06.856215 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60b501dcdb04dbebecdc6b69d5042dc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:06.861230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:06.861689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:06.862861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.863265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.863687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:06.867385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:06.891997 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:06.894822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ce042-85a2-49a8-8c08-bea14d32ea60 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:06.896516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:06.911401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1126/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:09:06.945915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60b501dcdb04dbebecdc6b69d5042dc', 'request_id': 'req-079ea652-188c-47bf-b86e-88f1c144fd9b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.955345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60b501dcdb04dbebecdc6b69d5042dc', 'request_id': 'req-079ea652-188c-47bf-b86e-88f1c144fd9b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.964368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60b501dcdb04dbebecdc6b69d5042dc', 'request_id': 'req-079ea652-188c-47bf-b86e-88f1c144fd9b'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.977765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] The token cache is being invalidate because project c60b501dcdb04dbebecdc6b69d5042dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:09:06.978107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.978835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-079ea652-188c-47bf-b86e-88f1c144fd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:06.980925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1128/2254] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:09:06 2022] DELETE /identity/v3/projects/c60b501dcdb04dbebecdc6b69d5042dc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:09:06.987776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:06.988102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:06.988369 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.011329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:07.012942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:07.058680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:07.099171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1127/2255] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:09:07.107340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.107638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.107928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.133755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:07.135245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:07.150759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1129/2256] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:07.151976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.171135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1115f-1eef-448f-a1e3-44d7b84f8f5d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.180328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.181874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.182659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.183306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.184619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:09:07.185332 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.188789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.218719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1128/2257] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:09:07.224261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.242324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be818-e23a-40ff-bb6b-7527fa6385c8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.252354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.253606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.254170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.254780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.256204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.261460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.315341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.316019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1130/2258] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:09:07 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:09:07.331265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa0ea-1a39-4673-b804-ae40d17113af admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.413538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.414316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.414834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.414964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.415532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.417872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.450464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1129/2259] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:09:07 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:09:07.456013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.469176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b687c-08e1-4c01-ac02-f93e0efe61ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.474322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.474956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.475634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.475845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.476421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.479229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.500734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1131/2260] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:09:07.504212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.524777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd81e-0ffc-4bc3-ac7e-8809cf130d2f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.536256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.537196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.537664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.538040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.538883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.540741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148378bb-5599-4dd3-9082-bc3e9be045d1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.568295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1130/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:09:07.569594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.588384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6e06-a5eb-40ab-81ce-f75780a40a2c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.605485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.606179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.606512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.606826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] PATH_INFO: `/v3/projects/539d10de50b7445289ee62942924455a/users/8b03b0b3e4e84704a27d4d217e959309/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.626410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=539d10de50b7445289ee62942924455a, user_id=8b03b0b3e4e84704a27d4d217e959309, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.629461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.651516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1132/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:09:07 2022] PUT /identity/v3/projects/539d10de50b7445289ee62942924455a/users/8b03b0b3e4e84704a27d4d217e959309/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:09:07.670637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.670956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.671746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.708307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] MFA Rules not processed for user `8b03b0b3e4e84704a27d4d217e959309`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:07.710213 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:07.830046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1131/2263] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:07.842229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:07.844126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:07.915045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c337b1-3b4c-4511-a942-68d5ef0e8ccd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:07.920292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:07.921828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:07.922364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:07.922827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:07.934056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:07.935576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:07.946159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1133/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:09:10.975655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:10.979149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:11.032662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:11.060116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67df2b8-6a1c-41d3-b8ee-0632c9d88c20 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:11.064183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:11.064886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:11.065178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:11.065453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:11.067290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:11.196273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:11.199187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b5892-9f34-4fde-bc11-9297c65118f9 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:11.232506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1132/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:13.687722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:13.786615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:13.830106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c9e1-4b92-4c7f-a63e-51568bb7276d service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:13.839466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:13.840776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:13.841277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:13.841883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] PATH_INFO: `/v3/users/8b03b0b3e4e84704a27d4d217e959309` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:13.845168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b03b0b3e4e84704a27d4d217e959309)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:13.849456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:13.941694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b03b0b3e4e84704a27d4d217e959309'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:13.942654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b03b0b3e4e84704a27d4d217e959309'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:13.960879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b03b0b3e4e84704a27d4d217e959309'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:13.989643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b03b0b3e4e84704a27d4d217e959309'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:13.990580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b03b0b3e4e84704a27d4d217e959309'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:14.023411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1134/2266] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:09:13 2022] DELETE /identity/v3/users/8b03b0b3e4e84704a27d4d217e959309 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:09:14.030829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:14.031381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:14.031381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:14.054793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:14.057045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:14.154624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1133/2267] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:14.164361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:14.166633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:14.281012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86347069-9fd8-48a1-ba14-a69bee54fe7d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:14.288582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:14.291805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:14.292475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:14.295409 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:14.317412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:14.318944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f645b-ca9f-4bc0-829e-c3e0ef684db1 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:14.334491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1135/2268] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:14.876127 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:14.877905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:14.892327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a309323-5107-4a98-927c-12e03d32ae61 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:14.899972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:14.900657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:14.901092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:14.901448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] PATH_INFO: `/v3/projects/539d10de50b7445289ee62942924455a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:14.902826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=539d10de50b7445289ee62942924455a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:14.904840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:15.017980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539d10de50b7445289ee62942924455a', 'request_id': 'req-3caf14e9-9f09-4045-970c-2bd24a342cac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:15.039731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539d10de50b7445289ee62942924455a', 'request_id': 'req-3caf14e9-9f09-4045-970c-2bd24a342cac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:15.056090 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539d10de50b7445289ee62942924455a', 'request_id': 'req-3caf14e9-9f09-4045-970c-2bd24a342cac'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:15.110561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] The token cache is being invalidate because project 539d10de50b7445289ee62942924455a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:09:15.111543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:15.112911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3caf14e9-9f09-4045-970c-2bd24a342cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:09:15.116243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1134/2269] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:09:14 2022] DELETE /identity/v3/projects/539d10de50b7445289ee62942924455a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:09:18.895796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:18.896394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:18.896491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:18.916852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] MFA Rules not processed for user `1587552a5e6d47f0af519679a08f7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:18.918066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:18.974134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1136/2270] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:25.085349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:28.966534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:41.321473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa381f3-4bdf-4301-93bd-c697a5dbbf70 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:41.322396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa381f3-4bdf-4301-93bd-c697a5dbbf70 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:41.322396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa381f3-4bdf-4301-93bd-c697a5dbbf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:41.346228 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-6fa381f3-4bdf-4301-93bd-c697a5dbbf70 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:41.347515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6fa381f3-4bdf-4301-93bd-c697a5dbbf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:41.454198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1135/2271] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:09:41.525038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:41.526895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:41.643161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785b4a7-f164-41d6-872e-86d97cfc2a07 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:41.648840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:41.649572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:41.650142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:41.650542 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:41.673799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:41.675623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6005ab8-ba98-4c2d-9477-d4f8c9b47a71 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:41.686697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1137/2272] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:09:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:09:51.440007 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=25 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:51.682504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=32 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:09:57.663494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:57.664039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:57.664039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:57.666212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1136/2273] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 10:09:57.673028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7de63-beeb-4d59-b925-28080b07ec84 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:57.673527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7de63-beeb-4d59-b925-28080b07ec84 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:57.673740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7de63-beeb-4d59-b925-28080b07ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:57.694007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4bc7de63-beeb-4d59-b925-28080b07ec84 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:57.695387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4bc7de63-beeb-4d59-b925-28080b07ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:57.768028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1138/2274] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:09:57.780452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:57.782702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:57.846645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a3ec-e34c-4e1e-873f-338b76734006 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:57.850178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:57.850806 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:57.851084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:57.851357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:57.861680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:57.863131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76e7c2-8743-4a55-a11e-fc44fbcf9b9b service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:57.873595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1137/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:57.941808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:57.942094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:57.942411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:57.943820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1139/2276] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:09:57.948607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597c1ea-e647-4fa3-a284-7ac9a2d48378 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:57.948887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597c1ea-e647-4fa3-a284-7ac9a2d48378 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:57.949157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597c1ea-e647-4fa3-a284-7ac9a2d48378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:57.968649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e597c1ea-e647-4fa3-a284-7ac9a2d48378 None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:57.969854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e597c1ea-e647-4fa3-a284-7ac9a2d48378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:58.020272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1138/2277] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:58.032018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:58.033780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:58.047574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785db0e0-6200-4bce-aba3-473a9ba15ac9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:58.051206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:58.051800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:58.052081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:58.052353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:58.059293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:58.060706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aaa2e-5adf-4177-b9ba-5389d4a9f055 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:58.069046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1140/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:09:58.155324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ffe7-5177-4558-b935-17c0a6715f03 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:58.155614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ffe7-5177-4558-b935-17c0a6715f03 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:58.155900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ffe7-5177-4558-b935-17c0a6715f03 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:58.157310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1139/2279] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:09:58.162782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca01c4-8028-44b9-93a1-1a89f089ba78 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:58.163244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca01c4-8028-44b9-93a1-1a89f089ba78 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:58.163536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca01c4-8028-44b9-93a1-1a89f089ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:58.183400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0cca01c4-8028-44b9-93a1-1a89f089ba78 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:09:58.184614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0cca01c4-8028-44b9-93a1-1a89f089ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:09:58.195483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1141/2280] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:09:58.206491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ffe7-5177-4558-b935-17c0a6715f03 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:09:58.219200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ffe7-5177-4558-b935-17c0a6715f03 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:09:58.223146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:09:58.223917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:09:58.224243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:09:58.224569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:09:58.236660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:09:58.238103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:09:58.249631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1140/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:10:01.044343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5070d-ebe2-430f-8eae-b664ca1b4da6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:10:01.045196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5070d-ebe2-430f-8eae-b664ca1b4da6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:10:01.045344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5070d-ebe2-430f-8eae-b664ca1b4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:10:01.071520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-95c5070d-ebe2-430f-8eae-b664ca1b4da6 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:10:01.072945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-95c5070d-ebe2-430f-8eae-b664ca1b4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:10:01.080556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1142/2282] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:10:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:10:01.094844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:10:01.109420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77afa25-821f-4b19-af5e-8791b511e8ed service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:10:01.116708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:10:01.117928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:10:01.118424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:10:01.118707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:10:01.131055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:10:01.132916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:10:01.142193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1141/2283] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:10:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:10:11.065520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=43 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:10:11.138336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=61 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:10:28.626508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:10:28.627138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:10:28.627138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:10:28.648501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:10:28.649764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:10:28.658073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1143/2284] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:10:28.672206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:10:28.683515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7060eb2-fc11-4760-bdb8-ecbc5f4490d4 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:10:28.689169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:10:28.689786 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:10:28.690070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:10:28.690426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:10:28.699794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:10:28.701421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:10:28.711890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1142/2285] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:10:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:10:38.642296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:10:38.707615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:11:13.669829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:13.671257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:13.683333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de2b10-25e7-4462-b070-7493dccdf1e2 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:13.688641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:13.689280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:13.689537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:13.689814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:13.691634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:13.705655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:13.707129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:13.719170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1144/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:15.115981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:15.125744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2451-7dc0-48d0-bf9b-071fe61ce11b service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:15.129727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:15.130462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:15.130746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:15.131023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:15.134108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:15.153538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:15.155023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd098c9-ae3f-4bbe-a6a2-1e6baf60940f service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:15.168240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1143/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:11:18.231128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:18.232685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:18.246407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f3a0-9d7c-42ee-800d-cd2547b0e2ee service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:18.251978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:18.252580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:18.252927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:18.253210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:18.254999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:18.266582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:18.268164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44578e5-1491-4246-811d-380bb06ec196 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:18.277445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1145/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:25.163326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:11:28.272987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=12 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:11:28.587027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:28.587530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:28.587635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:28.608765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] MFA Rules not processed for user `1587552a5e6d47f0af519679a08f7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:11:28.609638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:28.617328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1144/2289] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:11:31.398628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:31.399120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:31.399217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:31.418532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] MFA Rules not processed for user `f0096ff6416148d4a75e70393efec73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:11:31.419751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:31.477528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1146/2290] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:11:35.840822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:35.857240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be598ca-4387-4b96-97bf-fdf200916d77 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:35.862912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:35.863571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:35.863827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:35.864098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:35.865887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:35.932049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:35.933693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:35.944869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1145/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:36.660640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:36.662187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:36.680446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bff90-376a-45cc-84f7-72537dd02a8b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:36.687015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:36.687655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:36.688076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:36.688472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:36.690482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:36.702003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:36.703687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2974c0e-6930-4d0b-a9df-3bf6dd6df18b service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:36.713840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1147/2292] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:44.186424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:44.198507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e3b46-0dd2-4f88-823d-4eddf003fb25 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:44.203963 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:44.204861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:44.206378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:44.207117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:44.209299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:44.223661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:44.226951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:44.241687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1146/2293] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:46.710095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=31 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:11:48.195695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:48.196659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:48.196943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:48.216759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] MFA Rules not processed for user `680128c3fd934178b5d8d1370bb3729f`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:11:48.217999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:48.227780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1148/2294] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:11:48.571903 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:48.582153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6200-0652-4de0-9257-30bb3beee76d service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:48.586666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:48.587488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:48.587767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:48.588048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:48.590849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:48.602858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:48.604299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:48.614314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1147/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:48.958379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:11:48.959779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:49.046444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650bfc-e787-44c7-a55e-c67c4b08e250 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:11:49.051675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:11:49.052289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:11:49.052578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:11:49.052862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:11:49.054742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:11:49.066753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:11:49.068354 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:11:49.079138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1149/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:11:58.610579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=43 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:11:59.074206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=35 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:00.565794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:00.593540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701b6e-7898-4f3c-b746-b5e6490cf3da service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:00.605877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:00.607886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:00.609142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:00.609881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:00.613708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:00.640776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:00.645189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb579-34c6-4782-adc0-2f9834248dad service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:00.671716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1148/2297] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:12:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:12:01.973069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:01.998348 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece716-e6ae-48a5-8044-b6e6bbe63f33 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:02.009865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:02.009865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:02.009865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:02.010607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:02.014729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:02.044191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:02.048600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:02.073250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1150/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:12:10.661058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:12.062396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:12.332343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:12.332343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:12.332343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:12.354568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:12:12.356666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:12.366259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1149/2299] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:12:12.422300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:12.435951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4060-3826-431b-b89a-b195bacd7bb2 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:12.441644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:12.442303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:12.442589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:12.442864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:12.453192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:12.455104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:12.465106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1151/2300] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:12:16.536275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:16.559456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f2f4c-8e41-43b2-b6bd-20b2adfcfeb5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:16.566418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:16.567219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:16.567691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:16.568006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:16.570412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:16.588152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:16.591892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:16.611612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1150/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:12:21.183902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:21.186488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:21.280499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7993ca9-2299-497d-a85f-a4f07b9856df service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:21.285351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:21.286005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:21.286305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:21.286583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] PATH_INFO: `/v3/users/1b765b23cd2140979234a96624e57492` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:21.287803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b765b23cd2140979234a96624e57492)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:21.289812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:21.354515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b765b23cd2140979234a96624e57492'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.355216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b765b23cd2140979234a96624e57492'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.364384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b765b23cd2140979234a96624e57492'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.380594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b765b23cd2140979234a96624e57492'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.381462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b765b23cd2140979234a96624e57492'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.398264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1152/2302] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:12:21 2022] DELETE /identity/v3/users/1b765b23cd2140979234a96624e57492 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:12:21.636548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:21.649677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca6a5-d0bf-467c-bf5f-a0b348915a97 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:21.723964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:21.724517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:21.724794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:21.725064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] PATH_INFO: `/v3/projects/c4d05e4df1b94368a145c961b06c1644` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:21.726327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d05e4df1b94368a145c961b06c1644)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:21.729102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:21.785207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d05e4df1b94368a145c961b06c1644', 'request_id': 'req-ce912581-1dc0-4211-9cd8-e949a01934e7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.792610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d05e4df1b94368a145c961b06c1644', 'request_id': 'req-ce912581-1dc0-4211-9cd8-e949a01934e7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.802574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d05e4df1b94368a145c961b06c1644', 'request_id': 'req-ce912581-1dc0-4211-9cd8-e949a01934e7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.816586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] The token cache is being invalidate because project c4d05e4df1b94368a145c961b06c1644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:12:21.816888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.817623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.819234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1151/2303] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:12:21 2022] DELETE /identity/v3/projects/c4d05e4df1b94368a145c961b06c1644 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:12:21.823387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:21.825377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:21.839562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5d622-818b-4633-9fe2-81046373e44c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:21.910397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:21.911060 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:21.911339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:21.911610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] PATH_INFO: `/v3/users/92be39213df84e55a433919f8279d652` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:21.912786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92be39213df84e55a433919f8279d652)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:21.914763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:21.921373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:21.978515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92be39213df84e55a433919f8279d652'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.979146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92be39213df84e55a433919f8279d652'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:21.987468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92be39213df84e55a433919f8279d652'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.000756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92be39213df84e55a433919f8279d652'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.001529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92be39213df84e55a433919f8279d652'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.018072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1153/2304] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:12:21 2022] DELETE /identity/v3/users/92be39213df84e55a433919f8279d652 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:12:22.220347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:22.222815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:22.246328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce912581-1dc0-4211-9cd8-e949a01934e7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:22.331541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:22.332634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:22.333160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:22.333658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] PATH_INFO: `/v3/projects/f39d4cd746134a018bf2003c38aae63f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:22.335881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39d4cd746134a018bf2003c38aae63f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:22.339555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:22.362109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:22.411985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39d4cd746134a018bf2003c38aae63f', 'request_id': 'req-e9fc4452-7ab0-4ac8-8694-d0562083c09c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.420581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39d4cd746134a018bf2003c38aae63f', 'request_id': 'req-e9fc4452-7ab0-4ac8-8694-d0562083c09c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.430727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39d4cd746134a018bf2003c38aae63f', 'request_id': 'req-e9fc4452-7ab0-4ac8-8694-d0562083c09c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.452565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] The token cache is being invalidate because project f39d4cd746134a018bf2003c38aae63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:12:22.453257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.454601 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e9fc4452-7ab0-4ac8-8694-d0562083c09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:12:22.457259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1152/2305] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:12:22 2022] DELETE /identity/v3/projects/f39d4cd746134a018bf2003c38aae63f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:12:32.013709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:32.446150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:37.471064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:37.472629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:37.543249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb327c1-8c40-433b-98b4-fa2954e67eb9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:37.605128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:37.605964 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:37.606390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:37.606767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:37.608849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:37.683455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:37.685027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:37.695029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1154/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:12:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:12:44.972084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:44.972712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:44.972712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:44.995588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] MFA Rules not processed for user `5a424b3a933741549c26a4ffc5ecaf93`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:12:44.997386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:45.004703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1153/2307] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:12:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:12:47.690502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=68 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:54.989304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:12:58.311349 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:12:58.313336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:58.438980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718a47-cb26-414b-b3ed-8a6261c3a09c service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:12:58.444528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:12:58.445149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:12:58.445429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:12:58.445707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:12:58.447470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:12:58.460638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:12:58.462285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:12:58.474219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1155/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:04.204998 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:04.207168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:04.276969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79660-bf4b-40a7-985d-0af926459a2f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:04.281483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:04.282561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:04.282914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:04.283188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:04.285070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:04.367004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:04.368423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:04.381430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1154/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:08.095320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.096714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:08.155467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.157540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:08.173584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81400ea-a5e6-4ec4-a03e-6fb076e998aa service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:08.180370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:08.181109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.181599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.182028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] PATH_INFO: `/v3/users/f0096ff6416148d4a75e70393efec73a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.183266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0096ff6416148d4a75e70393efec73a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:08.185190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:08.189050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3ad29-1326-4cfd-8355-802c9cee7b20 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:08.200197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:08.201181 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.201463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.201736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.204053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:08.223969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:08.227462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:08.244988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1156/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:08.268499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0096ff6416148d4a75e70393efec73a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.269277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0096ff6416148d4a75e70393efec73a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.278098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0096ff6416148d4a75e70393efec73a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.295315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0096ff6416148d4a75e70393efec73a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.296181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-768617d4-a29e-4d9d-b20a-85f6c4f36c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0096ff6416148d4a75e70393efec73a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.311121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1155/2311] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:08 2022] DELETE /identity/v3/users/f0096ff6416148d4a75e70393efec73a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:08.499566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.512197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebc84-dc3e-4917-87ed-c832ab342409 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:08.578655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:08.579281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.579559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.579832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] PATH_INFO: `/v3/projects/54661ad4d0cc49449d4b424e345c0637` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.580948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54661ad4d0cc49449d4b424e345c0637)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:08.582876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:08.600276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:08.637626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54661ad4d0cc49449d4b424e345c0637', 'request_id': 'req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.652150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54661ad4d0cc49449d4b424e345c0637', 'request_id': 'req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.661031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54661ad4d0cc49449d4b424e345c0637', 'request_id': 'req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.673818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] The token cache is being invalidate because project 54661ad4d0cc49449d4b424e345c0637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:08.674173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.675035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d17fc34d-d0f4-42f6-b161-4b0b65ceacd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:08.679948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1157/2312] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:08 2022] DELETE /identity/v3/projects/54661ad4d0cc49449d4b424e345c0637 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:08.682331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.682331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.682331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.709318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:08.711123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:08.734354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:08.800132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1156/2313] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:08.801939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.802186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.802492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.834110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:08.835393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:08.843874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1158/2314] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:08.849216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.859062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42825cd6-227f-46fa-9885-7087440b8ea2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:08.863956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:08.864572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.864858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.865135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.865790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:13:08.866095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:08.867721 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:08.880392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1157/2315] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:13:08.885072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.895120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61056ad-1dce-4592-8fda-4703d6834c0a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:08.899785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:08.900414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:08.900668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:08.900944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:08.901578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:08.903508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:08.930854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1159/2316] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:08 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:08.935719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:08.945780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152041c-c4ff-4b41-8dc2-32d0bd09c6cd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.002924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.003557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.003839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.004114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.004750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.006714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.027502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1158/2317] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:08 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:13:09.031775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.041986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee749c-9c3d-457a-be5d-5664f862659d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.047250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.047851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.048129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.048402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.049043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.050662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.061059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1160/2318] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:09.064971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.074919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909854-4826-4a44-b05a-4763cba98fc1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.079796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.080416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.080698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.080971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.081615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.083445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa91f6-f615-4dc5-b550-4c525d397611 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.094094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1159/2319] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:09.098175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.108516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2156b0-e80d-4477-bc4f-38bd12bdcf5a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.113110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.113783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.114058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.114371 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] PATH_INFO: `/v3/projects/6632f50e7c154e48b9355881c9854111/users/81d485a8826647b6a8a7aeed1f408347/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.129075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6632f50e7c154e48b9355881c9854111, user_id=81d485a8826647b6a8a7aeed1f408347, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.131825 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.158160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1161/2320] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:09 2022] PUT /identity/v3/projects/6632f50e7c154e48b9355881c9854111/users/81d485a8826647b6a8a7aeed1f408347/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:09.168837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.169377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.169377 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.198558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] MFA Rules not processed for user `81d485a8826647b6a8a7aeed1f408347`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:09.199823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:09.265146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1160/2321] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:09.269817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.332046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbca13-827e-4b09-bc57-b78fda5d487f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.336652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.337253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.337531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.337801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.338488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.340674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.367633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1162/2322] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:09.372500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.384024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a749c5-3a3c-43d3-9da6-9ae0274a32ec None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.397232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:09.450862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.451491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.451774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.452047 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.452688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.454692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.477083 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1161/2323] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:09 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:09.487131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.493226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4454e4-806f-4b00-9e68-41cdc4798b18 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.498199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.498847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.499125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.499454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.500102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.501695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.513460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1163/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:09.517739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.528432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c8aa-96dd-425b-83fb-82717dfaaa70 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.533378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.534058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.534373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.534676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] PATH_INFO: `/v3/projects/c7d7f27637374b639b65a161d70cc278/users/c85eef91bca84d8d9ef6a1efa1445a76/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.559050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d7f27637374b639b65a161d70cc278, user_id=c85eef91bca84d8d9ef6a1efa1445a76, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.561753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.577322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1162/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:09 2022] PUT /identity/v3/projects/c7d7f27637374b639b65a161d70cc278/users/c85eef91bca84d8d9ef6a1efa1445a76/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:09.581430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.593394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5d02-0779-4407-9575-d1d58cef4c1d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.608358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:09.663421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.664828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.664828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.664828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.665200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.666847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915386ea-eaed-4637-a7a6-953a64a98202 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.681438 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1164/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:09.685500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.696529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfcced-001b-4844-90be-caff140e7eb7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.700926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.701825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.702111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.702434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] PATH_INFO: `/v3/projects/c7d7f27637374b639b65a161d70cc278/users/c85eef91bca84d8d9ef6a1efa1445a76/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.706694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d7f27637374b639b65a161d70cc278, user_id=c85eef91bca84d8d9ef6a1efa1445a76, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.709543 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.723750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1163/2327] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:09 2022] PUT /identity/v3/projects/c7d7f27637374b639b65a161d70cc278/users/c85eef91bca84d8d9ef6a1efa1445a76/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:09.736459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.736724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.736999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.768737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] MFA Rules not processed for user `c85eef91bca84d8d9ef6a1efa1445a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:09.769975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:09.847100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1165/2328] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:09.862129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:09.867667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:09.964604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487fbc-0e9c-43f2-aa5a-2a3cb1c975c2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:09.969046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:09.969742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:09.970096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:09.970472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:09.981358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:09.982960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d141877-c016-48d5-a8ef-a1e68aebb7b4 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:09.996391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1164/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:10.096942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:10.106474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11910ef-c581-427e-9691-0141ec2ec3d4 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:10.110167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:10.110793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:10.111075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:10.111350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:10.169364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:10.170853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:10.179659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1166/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:18.010853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:18.011415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:18.011415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:18.030816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] MFA Rules not processed for user `1587552a5e6d47f0af519679a08f7300`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:18.032064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:18.094326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1165/2331] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:18.413911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:18.415373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:18.457873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:18.479246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4466e92-ccea-46c4-a303-bc5ce86d2007 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:18.482346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:18.482974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:18.483256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:18.483532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:18.485327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:18.495792 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:18.497248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd322-8be0-4e20-944f-924ae5f30ca9 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:18.505744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1167/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:13:28.081729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:28.502076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=10 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:40.376809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:40.452168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019de14-2774-4895-a757-4fe5846d1392 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:40.456900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:40.457564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:40.457846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:40.458123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] PATH_INFO: `/v3/users/81d485a8826647b6a8a7aeed1f408347` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:40.459371 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d485a8826647b6a8a7aeed1f408347)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:40.461490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:40.529573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d485a8826647b6a8a7aeed1f408347'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:40.530311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d485a8826647b6a8a7aeed1f408347'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:40.539835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d485a8826647b6a8a7aeed1f408347'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:40.555315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d485a8826647b6a8a7aeed1f408347'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:40.556070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d485a8826647b6a8a7aeed1f408347'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:40.572518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1166/2333] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:40 2022] DELETE /identity/v3/users/81d485a8826647b6a8a7aeed1f408347 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:40.577037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:40.577495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:40.577632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:40.598905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:40.600139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:40.661341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1168/2334] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:40.672195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:40.673653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:40.740465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b5df-8148-4056-a0b2-372f0084a2fd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:40.745034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:40.745679 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:40.745960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:40.746260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:40.756117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:40.757488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:40.767307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1167/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:41.130358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:41.132132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:41.145247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eceae-e79d-4f31-950e-2af1420b5df7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:41.153096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:41.154047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:41.154551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:41.154975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] PATH_INFO: `/v3/projects/6632f50e7c154e48b9355881c9854111` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:41.156775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6632f50e7c154e48b9355881c9854111)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:41.160707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:41.227088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6632f50e7c154e48b9355881c9854111', 'request_id': 'req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.237756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6632f50e7c154e48b9355881c9854111', 'request_id': 'req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.249210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6632f50e7c154e48b9355881c9854111', 'request_id': 'req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.262536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] The token cache is being invalidate because project 6632f50e7c154e48b9355881c9854111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:41.262764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.263397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.272627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1169/2336] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:41 2022] DELETE /identity/v3/projects/6632f50e7c154e48b9355881c9854111 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:41.272867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:41.280017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0b84a-99ae-4b67-8aa6-1b16702d6507 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:41.306790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:41.352289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:41.352927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:41.353204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:41.353478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] PATH_INFO: `/v3/users/c85eef91bca84d8d9ef6a1efa1445a76` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:41.354698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85eef91bca84d8d9ef6a1efa1445a76)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:41.356635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:41.414042 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85eef91bca84d8d9ef6a1efa1445a76'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.414792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85eef91bca84d8d9ef6a1efa1445a76'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.422125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85eef91bca84d8d9ef6a1efa1445a76'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.435154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85eef91bca84d8d9ef6a1efa1445a76'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.435905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9848e25b-89d5-4fb1-b95a-50129b1d82aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85eef91bca84d8d9ef6a1efa1445a76'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.452629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1168/2337] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:41 2022] DELETE /identity/v3/users/c85eef91bca84d8d9ef6a1efa1445a76 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:41.764198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:41.765779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:41.779637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98db56b-e81c-47bd-abba-87e3a4c9cf6d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:41.842871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:41.843515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:41.843797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:41.844074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] PATH_INFO: `/v3/projects/c7d7f27637374b639b65a161d70cc278` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:41.845455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d7f27637374b639b65a161d70cc278)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:41.847230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:41.880970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:41.905032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d7f27637374b639b65a161d70cc278', 'request_id': 'req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.913386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d7f27637374b639b65a161d70cc278', 'request_id': 'req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.922141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d7f27637374b639b65a161d70cc278', 'request_id': 'req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.939572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] The token cache is being invalidate because project c7d7f27637374b639b65a161d70cc278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:41.940092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.941123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0eb7c6ef-fcca-4d05-8e57-b9e5f25e1426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:41.943599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1170/2338] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:41 2022] DELETE /identity/v3/projects/c7d7f27637374b639b65a161d70cc278 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:41.949490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:41.949769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:41.950032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:41.977777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:41.980430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:42.069783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1169/2339] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:42.081857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.082291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.082654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.114624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:42.116843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:42.128150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1171/2340] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:42.132567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.145356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c36868-d0d4-45e4-a120-13550a90b216 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.152698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.153408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.153746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.154080 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.154857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:13:42.155234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.157188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.178149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1170/2341] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:13:42.183984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.201023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92718a5-ce34-4ad5-97ad-7712459ef845 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.208734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.209787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.210314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.210810 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.212047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.216155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.270796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1172/2342] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:13:42.271004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.278871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79b232-c657-4991-8249-ad6c18e77a2e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.312087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:42.347827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.348448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.348729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.349000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.349645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.351808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.376157 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1171/2343] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:42.381717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.392803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204e0be-39b7-42ff-8a7e-0356bd14262c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.398130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.398833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.399191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.399525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.400855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.403257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.417803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1173/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:42.422844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.434761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c468-6a68-478f-aec8-9e43119c6e38 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.439669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.440302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.440576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.440853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.441508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.443169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c2ada-3ab4-4fd6-9cda-a771eccbe725 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.455107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1172/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:13:42.460200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.472457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3ef8-98c1-45ad-9e0b-9fc65e019b68 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.478073 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.479331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.479611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.479882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] PATH_INFO: `/v3/projects/34995458b736486cb2264e6e74feeadd/users/f89f14c7a19a4cbb97adb9eaf5eac082/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.496645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34995458b736486cb2264e6e74feeadd, user_id=f89f14c7a19a4cbb97adb9eaf5eac082, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.499367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.513592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1174/2346] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:42 2022] PUT /identity/v3/projects/34995458b736486cb2264e6e74feeadd/users/f89f14c7a19a4cbb97adb9eaf5eac082/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:42.524107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.524428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.524710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.563553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] MFA Rules not processed for user `f89f14c7a19a4cbb97adb9eaf5eac082`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:42.564710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:42.635017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1173/2347] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:42.639744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.714725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc491d-924f-457e-8bd3-42accff7c2cc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.724083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.724714 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.725004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.725277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.725930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.727881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.756166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1175/2348] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:42.760932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.773034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac486b2-4068-46a5-9338-4c59466188bb None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.833037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.833576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.833877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.834137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.834900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.836839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.860167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1174/2349] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:42 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:42.864294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.874720 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eafed-3a3b-489e-927b-90a43725c237 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.879450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.880058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.880342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.880622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.881268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.882922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.894722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1176/2350] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:13:42.898920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.909664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed467-43e9-442a-aed6-8b553d0c4934 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.914417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.915055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.915331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.915606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.916250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.917849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12b8e-97b0-4932-9abe-fdc3ad65950f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.928437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1175/2351] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:42.932700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:42.949529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c1031-84d1-47c0-abad-df27910120a8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:42.954377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:42.955080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:42.955360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:42.955634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] PATH_INFO: `/v3/projects/070bdecf39e24342aacb0765e694d293/users/7cfa3f25a5e74659a9a62dc233c1d47c/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:42.972401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070bdecf39e24342aacb0765e694d293, user_id=7cfa3f25a5e74659a9a62dc233c1d47c, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:42.975105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:42.985360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:42.990904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1177/2352] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:42 2022] PUT /identity/v3/projects/070bdecf39e24342aacb0765e694d293/users/7cfa3f25a5e74659a9a62dc233c1d47c/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:43.001724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.002006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.002306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.031687 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] MFA Rules not processed for user `7cfa3f25a5e74659a9a62dc233c1d47c`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:43.032824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.036827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:43.103820 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1176/2353] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:43.108533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.176999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6793fb-8965-414e-ad60-4a61d8bb06f7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.183001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.184457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.184835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.185182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.185862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.188091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.224954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1178/2354] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:43.225915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.238069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab2f2-14ca-4bbf-a907-70753c983114 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.302013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.302915 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.303362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.303801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.304620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.307283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.336971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1177/2355] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:43 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:43.338637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.360340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd01e-6581-4e07-adf4-fe926a23ea8e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.382137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.383246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.383534 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.383924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.384615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.387054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.408978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1179/2356] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:43.410490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.422976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838977c4-9f9a-4e33-86cd-67951ffa4505 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.428023 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.428793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.429153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.429497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] PATH_INFO: `/v3/projects/1e4544d11c9149f192ff2785b80d49d8/users/34314c4e19364b2db9c9df08b4945f9e/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.451437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4544d11c9149f192ff2785b80d49d8, user_id=34314c4e19364b2db9c9df08b4945f9e, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.454761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132c1c0-21db-4082-ad85-5e355eafae70 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.473715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1178/2357] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:43 2022] PUT /identity/v3/projects/1e4544d11c9149f192ff2785b80d49d8/users/34314c4e19364b2db9c9df08b4945f9e/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:43.477691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.491071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5074-7459-4e8c-8335-a06be21bc393 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.558509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.558827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.559105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.561104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.561721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.561984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.562358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.562939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.564526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.576936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1180/2358] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:43.580229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:43.580872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.581459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.592275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40414a-bd25-4e2e-84ee-eb483991357f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.597374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.598044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.598388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.598667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] PATH_INFO: `/v3/projects/1e4544d11c9149f192ff2785b80d49d8/users/34314c4e19364b2db9c9df08b4945f9e/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.604118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4544d11c9149f192ff2785b80d49d8, user_id=34314c4e19364b2db9c9df08b4945f9e, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.606858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05f59f-a218-4f25-adac-d489d19df898 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.617987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1181/2359] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:43 2022] PUT /identity/v3/projects/1e4544d11c9149f192ff2785b80d49d8/users/34314c4e19364b2db9c9df08b4945f9e/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:43.631004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.631293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.631571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.644449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1179/2360] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:13:43.663758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] MFA Rules not processed for user `34314c4e19364b2db9c9df08b4945f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:43.665030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.705412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.707623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.723167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:43.750323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:43.752061 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1182/2361] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:13:43.763922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.765418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.813400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63c99-2ac5-4e25-9e2c-82254e10128a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.830008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594939a-42c7-4fd7-8934-772643024b57 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.834745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.835373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.836063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.836341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.847148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.848550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.860926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1183/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:13:43.880204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.880827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.881114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.881432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.912634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:43.914519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:43.929645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9cfc0-d793-4e6b-86f4-9b1f3df6ebdc service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:43.933541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:43.934168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:43.934460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:43.934742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:43.954512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:43.956304 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:43.965941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1180/2363] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:13:44.042440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:44.044255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e960b-7364-4e74-8515-85a749a94c3d service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:44.061711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1184/2364] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:13:47.400888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:47.501402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b09a3-b2fa-48a1-bcc6-840eb8546ac9 service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:47.506877 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:47.507536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:47.507876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:47.508142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] PATH_INFO: `/v3/users/f89f14c7a19a4cbb97adb9eaf5eac082` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:47.510060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89f14c7a19a4cbb97adb9eaf5eac082)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:47.512421 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:47.514296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:47.586744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89f14c7a19a4cbb97adb9eaf5eac082'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:47.587463 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89f14c7a19a4cbb97adb9eaf5eac082'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:47.599765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89f14c7a19a4cbb97adb9eaf5eac082'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:47.624648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89f14c7a19a4cbb97adb9eaf5eac082'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:47.625746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89f14c7a19a4cbb97adb9eaf5eac082'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:47.651244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1181/2365] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:47 2022] DELETE /identity/v3/users/f89f14c7a19a4cbb97adb9eaf5eac082 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:47.658918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:47.659971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:47.659971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:47.709129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:47.716590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:47.820910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1185/2366] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:47.830757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:47.832508 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:47.924938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52e66-dcbd-4c1f-b548-a628a9d591fc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:47.932420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:47.934113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:47.935083 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:47.935861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:47.950966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:47.953061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:47.965671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1182/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:48.689314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:48.696146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:48.742283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64ead2-48d8-40ff-88a0-d2bcf07c7a8b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:48.748441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:48.749095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:48.749385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:48.749660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] PATH_INFO: `/v3/projects/34995458b736486cb2264e6e74feeadd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:48.750915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34995458b736486cb2264e6e74feeadd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:48.756421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:48.787475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:48.820739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34995458b736486cb2264e6e74feeadd', 'request_id': 'req-c1ae2114-8c7c-47ed-a59a-7376b43b9308'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:48.835584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34995458b736486cb2264e6e74feeadd', 'request_id': 'req-c1ae2114-8c7c-47ed-a59a-7376b43b9308'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:48.844666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34995458b736486cb2264e6e74feeadd', 'request_id': 'req-c1ae2114-8c7c-47ed-a59a-7376b43b9308'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:48.857382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] The token cache is being invalidate because project 34995458b736486cb2264e6e74feeadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:48.857677 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:48.858383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:48.860281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1186/2368] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:48 2022] DELETE /identity/v3/projects/34995458b736486cb2264e6e74feeadd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:48.864469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:48.875819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a149c-30b6-4188-a005-7981c60142b4 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:48.946128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:48.946886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:48.948603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:48.948603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] PATH_INFO: `/v3/users/7cfa3f25a5e74659a9a62dc233c1d47c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:48.949205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfa3f25a5e74659a9a62dc233c1d47c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:48.951252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:48.979108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:49.015953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfa3f25a5e74659a9a62dc233c1d47c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.016653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfa3f25a5e74659a9a62dc233c1d47c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.024649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfa3f25a5e74659a9a62dc233c1d47c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.040117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfa3f25a5e74659a9a62dc233c1d47c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.040910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfa3f25a5e74659a9a62dc233c1d47c'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.056847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1183/2369] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:48 2022] DELETE /identity/v3/users/7cfa3f25a5e74659a9a62dc233c1d47c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:49.402373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:49.404572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:49.421344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae2114-8c7c-47ed-a59a-7376b43b9308 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:49.519235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:49.519997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:49.520251 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:49.520563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] PATH_INFO: `/v3/projects/070bdecf39e24342aacb0765e694d293` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:49.522206 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070bdecf39e24342aacb0765e694d293)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:49.525488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:49.595253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070bdecf39e24342aacb0765e694d293', 'request_id': 'req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.606654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070bdecf39e24342aacb0765e694d293', 'request_id': 'req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.615423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070bdecf39e24342aacb0765e694d293', 'request_id': 'req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.632009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] The token cache is being invalidate because project 070bdecf39e24342aacb0765e694d293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:49.632309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.632982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.634544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1187/2370] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:49 2022] DELETE /identity/v3/projects/070bdecf39e24342aacb0765e694d293 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:49.638734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:49.641880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:49.677340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097db6-a82b-42a1-ac77-4bf2a726e4c7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:49.772894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:49.773654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:49.774159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:49.774604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] PATH_INFO: `/v3/users/34314c4e19364b2db9c9df08b4945f9e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:49.776516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34314c4e19364b2db9c9df08b4945f9e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:49.781865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:49.866335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34314c4e19364b2db9c9df08b4945f9e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.867176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34314c4e19364b2db9c9df08b4945f9e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.878542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34314c4e19364b2db9c9df08b4945f9e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.891945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34314c4e19364b2db9c9df08b4945f9e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.892736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-c6f8b94d-3239-4ca8-bf9e-eccacff06e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34314c4e19364b2db9c9df08b4945f9e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:49.922872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1184/2371] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:49 2022] DELETE /identity/v3/users/34314c4e19364b2db9c9df08b4945f9e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:50.281392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.283140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:50.306399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a70f1-c313-4ddf-8fe0-7010921d5ef7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.361822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:50.401001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.401652 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.401923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.402285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] PATH_INFO: `/v3/projects/1e4544d11c9149f192ff2785b80d49d8` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.403507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4544d11c9149f192ff2785b80d49d8)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.405476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:50.476557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4544d11c9149f192ff2785b80d49d8', 'request_id': 'req-0d827df4-9430-403b-90b1-c82e9c562ce2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:50.486041 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4544d11c9149f192ff2785b80d49d8', 'request_id': 'req-0d827df4-9430-403b-90b1-c82e9c562ce2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:50.494143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4544d11c9149f192ff2785b80d49d8', 'request_id': 'req-0d827df4-9430-403b-90b1-c82e9c562ce2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:50.506812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] The token cache is being invalidate because project 1e4544d11c9149f192ff2785b80d49d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:50.506812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:50.507130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d827df4-9430-403b-90b1-c82e9c562ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:50.508489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1188/2372] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:50 2022] DELETE /identity/v3/projects/1e4544d11c9149f192ff2785b80d49d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:13:50.516327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.516618 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.516916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.547959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:50.549309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:50.565591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:50.626289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1185/2373] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:50.635423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.635755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.635937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.658195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:50.659577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:50.668387 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1189/2374] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:13:50.672989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.685161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561be6-6300-412e-94df-76d3ab7a5c47 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.692428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.693244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.693657 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.694033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.694846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:13:50.695257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.697052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:50.710842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1186/2375] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:13:50.716068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.726526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb1094-d2db-4957-877e-16f177a29607 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.732303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.733026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.733380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.733724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.734484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.736701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:50.776063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1190/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:50 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:13:50.780490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.794126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7177-4f05-42d6-a966-fc78f593a55a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.872486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.873161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.873393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.873728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.874458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.876384 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:50.903819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1187/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:50 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:13:50.908005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.923390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e58c3-9f40-4ca0-a500-685c515a5643 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.930774 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.931091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.931911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.932192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.932858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.934654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:50.946730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1191/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:13:50.952187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:50.970226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cca0-331c-4cea-b874-430bc93c1978 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:50.979747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:50.980706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:50.981184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:50.983062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:50.983934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:50.985985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc4a5e-a627-4cb6-a135-0ea49a6e7611 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.003051 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1188/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:51.008126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.020816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fb036-f2cc-46c5-b381-ecbfbf482739 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.037645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.040403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.041352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.042083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] PATH_INFO: `/v3/projects/44f259372a5946c9b19fb5fff1be9bbf/users/03a6a650019a41078a10bbe9225fcb4a/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.062699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f259372a5946c9b19fb5fff1be9bbf, user_id=03a6a650019a41078a10bbe9225fcb4a, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.065655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.085486 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1192/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:51 2022] PUT /identity/v3/projects/44f259372a5946c9b19fb5fff1be9bbf/users/03a6a650019a41078a10bbe9225fcb4a/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:51.102702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.103761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.104316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.159812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] MFA Rules not processed for user `03a6a650019a41078a10bbe9225fcb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:51.162135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:51.323754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1189/2381] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:51.325785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.424747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee023e-cfb9-49cb-98dd-e08a8eefd6d2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.434818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.435576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.435917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.436193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.437592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.441222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.465659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:51.503764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1193/2382] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:51 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:51.508179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.523481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3dfa-46d1-44b1-a13a-60f7b8a8b9a0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.539193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:51.614831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.616882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.617506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.618337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.619836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.625939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.670457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1190/2383] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:51 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:51.674839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.694323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb86b-3dec-4968-b9cc-e2732c5c2ef6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.711566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.713914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.714524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.715356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.716970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.720497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.750292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1194/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:51.752544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.770934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a5423-1dac-4841-94ab-7703c09b1044 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.779246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.780419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.780913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.781948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] PATH_INFO: `/v3/projects/bdf6ada2cf3a497594051dd287357d92/users/a4db98ec841d4635a0382f2e679af95e/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.809018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf6ada2cf3a497594051dd287357d92, user_id=a4db98ec841d4635a0382f2e679af95e, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.814362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.837049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1191/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:51 2022] PUT /identity/v3/projects/bdf6ada2cf3a497594051dd287357d92/users/a4db98ec841d4635a0382f2e679af95e/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:51.841592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:51.852783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74c1a-bdf3-4abf-9e40-640d2604a871 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:51.947736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:51.948252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:51.948541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:51.948822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:51.949478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:51.953124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f28e8-f53f-487b-a185-f521feafe24c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:51.975113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1195/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:13:51.984950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:52.001275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810b8c-72ad-4362-8e83-15a93fc16d49 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:52.009832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:52.010582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:52.010863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:52.011148 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] PATH_INFO: `/v3/projects/bdf6ada2cf3a497594051dd287357d92/users/a4db98ec841d4635a0382f2e679af95e/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:52.013274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf6ada2cf3a497594051dd287357d92, user_id=a4db98ec841d4635a0382f2e679af95e, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:52.016040 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:52.034056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1192/2387] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:51 2022] PUT /identity/v3/projects/bdf6ada2cf3a497594051dd287357d92/users/a4db98ec841d4635a0382f2e679af95e/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:52.045716 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:52.046015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:52.046496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:52.080237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] MFA Rules not processed for user `a4db98ec841d4635a0382f2e679af95e`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:52.081511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:52.176850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1196/2388] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:52.191084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:52.193273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:52.270965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7435b9-ac18-4cbf-b337-7aa5042d87ac admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:52.275089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:52.275729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:52.275999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:52.276294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:52.293530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:52.295043 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:52.307907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1193/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:52.435314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:52.446519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea245-2582-44ea-9422-03869f34f71c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:52.451304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:52.452065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:52.452447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:52.452820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:52.538341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:52.540214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443f139-53b1-452f-a2b1-52903518fda8 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:52.547819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:52.558299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1197/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:57.641404 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:57.720976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:57.761547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d82fb-4c47-475a-b833-ac7e12caa08d service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:57.766529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:57.767161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:57.767435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:57.767701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] PATH_INFO: `/v3/users/03a6a650019a41078a10bbe9225fcb4a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:57.768828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a6a650019a41078a10bbe9225fcb4a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:57.770975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:57.833624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a6a650019a41078a10bbe9225fcb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:57.834322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a6a650019a41078a10bbe9225fcb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:57.842445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a6a650019a41078a10bbe9225fcb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:57.854574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a6a650019a41078a10bbe9225fcb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:57.855416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a6a650019a41078a10bbe9225fcb4a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:57.867866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1194/2391] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:57 2022] DELETE /identity/v3/users/03a6a650019a41078a10bbe9225fcb4a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:57.872425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207df8-f785-435b-984b-323b761882c5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:57.872896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207df8-f785-435b-984b-323b761882c5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:57.872992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd207df8-f785-435b-984b-323b761882c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:57.925848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dd207df8-f785-435b-984b-323b761882c5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:57.927117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd207df8-f785-435b-984b-323b761882c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:57.990836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1198/2392] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:58.002293 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:58.003834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:58.097970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda308fb-ddeb-4caf-8b5d-5976f75a16e1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:58.101699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:58.102336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:58.102617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:58.103076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:58.112784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:58.114233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:58.125838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1195/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:13:58.417370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd207df8-f785-435b-984b-323b761882c5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:58.419481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd207df8-f785-435b-984b-323b761882c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:58.441713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd207df8-f785-435b-984b-323b761882c5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:58.449986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:58.450766 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:58.451092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:58.451296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] PATH_INFO: `/v3/projects/44f259372a5946c9b19fb5fff1be9bbf` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:58.453064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f259372a5946c9b19fb5fff1be9bbf)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:58.455040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:58.511321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f259372a5946c9b19fb5fff1be9bbf', 'request_id': 'req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.520989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f259372a5946c9b19fb5fff1be9bbf', 'request_id': 'req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.528483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f259372a5946c9b19fb5fff1be9bbf', 'request_id': 'req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.541106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] The token cache is being invalidate because project 44f259372a5946c9b19fb5fff1be9bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:58.541331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.542533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.544129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1199/2394] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:58 2022] DELETE /identity/v3/projects/44f259372a5946c9b19fb5fff1be9bbf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:58.548454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:58.566118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aec9bd-4105-4c80-bbea-f44b7592d262 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:58.615359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:58.649867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:58.650694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:58.651161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:58.651521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] PATH_INFO: `/v3/users/a4db98ec841d4635a0382f2e679af95e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:58.653068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4db98ec841d4635a0382f2e679af95e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:58.655628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:58.716996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4db98ec841d4635a0382f2e679af95e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.717801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4db98ec841d4635a0382f2e679af95e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.724846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4db98ec841d4635a0382f2e679af95e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.738448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4db98ec841d4635a0382f2e679af95e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.739170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-3697cc0d-6b3f-4aa3-9018-387a5e607427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4db98ec841d4635a0382f2e679af95e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:58.753633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1196/2395] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:13:58 2022] DELETE /identity/v3/users/a4db98ec841d4635a0382f2e679af95e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:59.069923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.071402 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.095763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5aaea-3819-4fdf-ac6c-64fdcb3df085 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.155327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:59.164940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.166461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.166865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.167388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] PATH_INFO: `/v3/projects/bdf6ada2cf3a497594051dd287357d92` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.168721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf6ada2cf3a497594051dd287357d92)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.170730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.228347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf6ada2cf3a497594051dd287357d92', 'request_id': 'req-20726223-81e2-4da8-aacd-620c3da43052'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:59.239627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf6ada2cf3a497594051dd287357d92', 'request_id': 'req-20726223-81e2-4da8-aacd-620c3da43052'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:59.254418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf6ada2cf3a497594051dd287357d92', 'request_id': 'req-20726223-81e2-4da8-aacd-620c3da43052'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:59.266987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] The token cache is being invalidate because project bdf6ada2cf3a497594051dd287357d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:13:59.267284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:59.267962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-20726223-81e2-4da8-aacd-620c3da43052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:13:59.269460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1200/2396] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:13:59 2022] DELETE /identity/v3/projects/bdf6ada2cf3a497594051dd287357d92 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:59.277485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.278130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.278670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.355192 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:59.356455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.427695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1197/2397] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:13:59.435870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.436219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.436441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.458997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:59.460323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.469963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1201/2398] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:13:59.474725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.485443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b032dc-1617-403f-9bcf-d1a9d1b0f128 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.491621 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.492266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.492552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.492828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.493483 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:13:59.493832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.495464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcecdf-349e-4bb2-9635-c189d50ad6a7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.518673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1198/2399] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:13:59.524008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.543112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a38c5-3727-4abd-8c0c-a040ee4716ec None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.553883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.554673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.555398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.555773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.556865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.559641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.581859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638f4b-57b4-4a73-96f7-a5469f44084a None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.582048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638f4b-57b4-4a73-96f7-a5469f44084a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.582349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638f4b-57b4-4a73-96f7-a5469f44084a None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.585205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1199/2400] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:13:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:13:59.593163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.593509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.593796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.614674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1202/2401] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:59.618380 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.630800 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:59.658344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:59.659673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.741863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daecc76-a41d-48b4-8e08-e42e679aa706 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.747655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.748522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.748813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.749208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.749852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.752054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.775072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1200/2402] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:13:59.779665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1203/2403] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:13:59.784694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.788200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.795638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.797744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01765-3ca6-489d-937a-bcb7892c4229 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.803972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.804590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.804871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.805140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.805965 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.808777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.819298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1201/2404] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:13:59.823953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.836101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef137f-4937-491c-a276-e1773837ba02 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.842330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.842960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.843240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.843521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.844184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.845803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.859030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1202/2405] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:13:59.863809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:13:59.876315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:13:59.880390 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2e194-c5c7-4cf0-aaf2-25835cf66b2e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.883005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180694f-11e2-4763-be90-1abdcca454d9 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:13:59.886506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.887255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.887531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.887836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] PATH_INFO: `/v3/projects/9e0cdf28693243f794ba34670dad463f/users/4613cf0b03f24d13bdb59f35f9a5e245/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.888282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:13:59.888908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.889509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.889797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.901482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.902966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee423d8-3f6b-4d56-b17f-427d5adc9246 service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.905707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0cdf28693243f794ba34670dad463f, user_id=4613cf0b03f24d13bdb59f35f9a5e245, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:13:59.908470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422267-eb78-4401-a813-810d049b5eec admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:13:59.914642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1204/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:13:59.925977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1203/2407] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:13:59 2022] PUT /identity/v3/projects/9e0cdf28693243f794ba34670dad463f/users/4613cf0b03f24d13bdb59f35f9a5e245/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:13:59.937724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.938162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.938650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.971582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] MFA Rules not processed for user `4613cf0b03f24d13bdb59f35f9a5e245`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:13:59.973011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:13:59.992468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65ee-6d83-42e6-81d6-23a0cb9e8a24 None None] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.992848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65ee-6d83-42e6-81d6-23a0cb9e8a24 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:13:59.993140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65ee-6d83-42e6-81d6-23a0cb9e8a24 None None] PATH_INFO: `/` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:13:59.995160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1204/2408] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 10:13:59.999644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:13:59.999995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.000334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.021036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] MFA Rules not processed for user `d823e9d31401459cbf02d9360e9c8e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:00.022392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.041847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1205/2409] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:00.046140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.077020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1205/2410] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:00.089456 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.091119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.101869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcce4a-8a6a-4db9-aa51-2c7228937e0d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.106165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.106816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.107094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.107362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.114896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.116324 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.116509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699276-2c0b-4808-8a9d-110bd493d1fe None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.121982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.122634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.122921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.123201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.123843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.125211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1206/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:14:00.125763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e680f-7c2c-473f-ad96-b38d8e327024 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.161528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1206/2412] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:14:00 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:14:00.166021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.179397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f0a0-90a5-4a0a-9d06-fadad4b727ae service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.200918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:00.228375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ad2f-6d92-43cf-a9aa-63e98d66840c None None] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.228697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ad2f-6d92-43cf-a9aa-63e98d66840c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.228997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ad2f-6d92-43cf-a9aa-63e98d66840c None None] PATH_INFO: `/` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.230800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1207/2413] 10.222.0.20 () {54 vars in 921 bytes} [Wed Sep 21 10:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 10:14:00.236578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.236870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.237167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.249581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.250342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.250686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.251025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.251722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.253639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.260084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] MFA Rules not processed for user `3be328584a6549aeb096ab9b852daf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:00.261308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.277439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1207/2414] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:14:00 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:14:00.278799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.288704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e0e12-ffc8-4b74-92f3-077fe8b44e0d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.293946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.294600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.294857 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.295132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.295777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.297358 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.311194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1208/2415] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:14:00.312284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.319805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:00.322896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd4ac-2b0f-427d-add9-04c2b0034b07 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.328081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.328739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.329022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.329300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] PATH_INFO: `/v3/projects/e912889b50ac496cb255d3e03aad200a/users/be2d332f12d34836b840ce4c4469e097/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.334343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1208/2416] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Sep 21 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:00.345280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e912889b50ac496cb255d3e03aad200a, user_id=be2d332f12d34836b840ce4c4469e097, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.345722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.347111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.347887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.362802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1209/2417] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:00 2022] PUT /identity/v3/projects/e912889b50ac496cb255d3e03aad200a/users/be2d332f12d34836b840ce4c4469e097/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:14:00.366717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.414785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541f3a-f665-488f-ba84-77831cbb185a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.432987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee7af-6c67-4a6c-b2a9-684975cf592b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.437849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.438489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.438771 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.439046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.439702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.441299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.452572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1210/2418] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:14:00.458230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.471067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eaeac-0316-4b6c-9c83-8c57a58a0e79 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.476225 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.476713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.476988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.477272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] PATH_INFO: `/v3/projects/e912889b50ac496cb255d3e03aad200a/users/be2d332f12d34836b840ce4c4469e097/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.479794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e912889b50ac496cb255d3e03aad200a, user_id=be2d332f12d34836b840ce4c4469e097, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.482455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dc3eb-2d47-4dd4-8bff-48155facaf72 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.491281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.492877 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.493176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.493458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.497711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1211/2419] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:00 2022] PUT /identity/v3/projects/e912889b50ac496cb255d3e03aad200a/users/be2d332f12d34836b840ce4c4469e097/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:00.515044 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.515539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.516039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.566472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] MFA Rules not processed for user `be2d332f12d34836b840ce4c4469e097`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:00.568590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.570654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.571642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.583313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1209/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:00.651623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:00.689971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1212/2421] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:00.704603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.710890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:00.780733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10587-f6eb-4a77-911d-d008dca5791a service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.788358 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:00.845471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.846300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.846635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.847032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:00.858498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:00.859966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:00.871253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1210/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:00.957748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:00.968311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce3d5-d382-4786-bc7d-bdf20371796a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:00.972715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:00.973484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:00.973838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:00.974281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:01.038115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:01.039588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac359b-0964-4405-bce9-45316a46b548 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:01.049444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1213/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:01.332570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:01.398680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05563a-ab7d-4f7c-9130-2a311d6cdf74 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:01.405961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:01.406816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:01.407119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:01.407458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] PATH_INFO: `/v3/users/4613cf0b03f24d13bdb59f35f9a5e245` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:01.409187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4613cf0b03f24d13bdb59f35f9a5e245)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:01.411184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:01.457894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4613cf0b03f24d13bdb59f35f9a5e245'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:01.458562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4613cf0b03f24d13bdb59f35f9a5e245'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:01.466072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4613cf0b03f24d13bdb59f35f9a5e245'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:01.478658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4613cf0b03f24d13bdb59f35f9a5e245'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:01.479337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4613cf0b03f24d13bdb59f35f9a5e245'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:01.492249 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1211/2424] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:14:01 2022] DELETE /identity/v3/users/4613cf0b03f24d13bdb59f35f9a5e245 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:01.496975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:01.497344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:01.497703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:01.521808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:01.523058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:01.580984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1214/2425] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:01.592954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:01.594733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:01.628770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:01.655845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48bf44-ab2c-4b06-84b5-d03e75a8b5b2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:01.659566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:01.660176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:01.660461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:01.660739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:01.670008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:01.671493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:01.681434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1212/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:01.962555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:01.964066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:01.981646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508e9e1-2572-44ca-8d21-5a1bda6223ba None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:01.989261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:01.990173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:01.990470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:01.990719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] PATH_INFO: `/v3/projects/9e0cdf28693243f794ba34670dad463f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:01.992719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0cdf28693243f794ba34670dad463f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:01.995524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.061318 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0cdf28693243f794ba34670dad463f', 'request_id': 'req-9c852ea9-71d1-4908-b71b-3dad65d36b29'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.073439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0cdf28693243f794ba34670dad463f', 'request_id': 'req-9c852ea9-71d1-4908-b71b-3dad65d36b29'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.082861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0cdf28693243f794ba34670dad463f', 'request_id': 'req-9c852ea9-71d1-4908-b71b-3dad65d36b29'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.094437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] The token cache is being invalidate because project 9e0cdf28693243f794ba34670dad463f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:14:02.094734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.095417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.097115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1215/2427] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:14:01 2022] DELETE /identity/v3/projects/9e0cdf28693243f794ba34670dad463f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:02.100990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:02.113421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145437b0-f884-433d-afe6-6883e1b71876 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:02.184008 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:02.184674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.185004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.185306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] PATH_INFO: `/v3/users/be2d332f12d34836b840ce4c4469e097` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.186896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2d332f12d34836b840ce4c4469e097)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:02.189590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.242854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2d332f12d34836b840ce4c4469e097'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.244271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2d332f12d34836b840ce4c4469e097'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.253843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2d332f12d34836b840ce4c4469e097'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.271461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2d332f12d34836b840ce4c4469e097'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.272199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3f70d552-e02a-4dfa-adf5-5c4dd5672c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2d332f12d34836b840ce4c4469e097'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.303818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1213/2428] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:14:02 2022] DELETE /identity/v3/users/be2d332f12d34836b840ce4c4469e097 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:02.588099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:02.590036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.604844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852ea9-71d1-4908-b71b-3dad65d36b29 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:02.609808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:02.632454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.632972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.633072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.654021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:02.655574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.669429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:02.670103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.670513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.670791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] PATH_INFO: `/v3/projects/e912889b50ac496cb255d3e03aad200a` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.671930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e912889b50ac496cb255d3e03aad200a)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:02.674003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.714276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:02.724562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1214/2429] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:02.725757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e912889b50ac496cb255d3e03aad200a', 'request_id': 'req-bff90498-5d90-4452-a485-b0d4a5bfa29d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.733258 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e912889b50ac496cb255d3e03aad200a', 'request_id': 'req-bff90498-5d90-4452-a485-b0d4a5bfa29d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.738044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:02.739622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.742088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e912889b50ac496cb255d3e03aad200a', 'request_id': 'req-bff90498-5d90-4452-a485-b0d4a5bfa29d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.753002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] The token cache is being invalidate because project e912889b50ac496cb255d3e03aad200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:14:02.753282 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.753929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bff90498-5d90-4452-a485-b0d4a5bfa29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:02.755575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1216/2430] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:14:02 2022] DELETE /identity/v3/projects/e912889b50ac496cb255d3e03aad200a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:02.760530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cb84-666f-45cb-80e6-06ae62449bde None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.760757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cb84-666f-45cb-80e6-06ae62449bde None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.761039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7cb84-666f-45cb-80e6-06ae62449bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.781087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-11c7cb84-666f-45cb-80e6-06ae62449bde None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:02.782345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-11c7cb84-666f-45cb-80e6-06ae62449bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.811832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09979a5-d50f-4a16-a499-b075bf9239d9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:02.845093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1217/2431] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:02.852759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.853582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.853860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.872929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:02.874011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:02.874166 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.874671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.874979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.875250 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.876994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:02.882054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1218/2432] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:02.886191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:02.895271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37924-ae68-4f6b-a9e8-7eaccd2b0b9f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:02.900454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:02.901048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.901331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.901637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.902322 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:14:02.902627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:02.904210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.916663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1219/2433] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:14:02.921408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:02.942602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049718-0fed-4266-9b28-ea12776aaf35 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:02.949574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:02.950566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:02.951031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:02.951480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:02.952505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:02.952709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:02.955425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.955876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:02.969492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1215/2434] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:14:02.987301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:03.001803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1220/2435] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:14:02 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:14:03.003131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:03.015292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e219e-6f15-488e-a5f8-eb304b646ff5 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:03.067090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:03.093759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:03.094826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.095211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.095755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.096631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:03.099654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:03.139642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:03.141075 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1216/2436] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:14:03 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:14:03.151278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804298e5-2e32-4fcb-b442-9de14cdee874 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:03.156626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:03.157255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.157758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.158039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.158731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:03.160343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:03.175765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1221/2437] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:14:03.179952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:03.193298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409cb9-a4ec-40ac-b030-296da61eb9cc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:03.201335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:03.201335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.201335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.201335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.201829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:03.203434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1599e9b-5fc2-4a24-a490-233f230802b1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:03.223962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:03.224529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1217/2438] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:14:03.237992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10a85-980e-4221-81b8-ce23752f1361 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:03.247631 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:03.249599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.250374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.251149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] PATH_INFO: `/v3/projects/22f7a43206bc42e98323ff3019bef255/users/68f33fe618f64d06b89c3350dfc73b34/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.275723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f7a43206bc42e98323ff3019bef255, user_id=68f33fe618f64d06b89c3350dfc73b34, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:03.279059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:03.306698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f007-041f-4b79-8dad-25a27b7e57b4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.307312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f007-041f-4b79-8dad-25a27b7e57b4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.307759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f007-041f-4b79-8dad-25a27b7e57b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.311722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1222/2439] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:03 2022] PUT /identity/v3/projects/22f7a43206bc42e98323ff3019bef255/users/68f33fe618f64d06b89c3350dfc73b34/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:03.332858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2d64f007-041f-4b79-8dad-25a27b7e57b4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:03.334217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2d64f007-041f-4b79-8dad-25a27b7e57b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:03.419405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1218/2440] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:03.438110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:03.440311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:03.534898 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba3e3-b5f4-428c-b5d9-347279ee843c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:03.538801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:03.539428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:03.539919 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:03.540029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:03.556191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:03.557781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:03.570176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1223/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:04.389407 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.389958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.389958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.426046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] MFA Rules not processed for user `68f33fe618f64d06b89c3350dfc73b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:04.427328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:04.506295 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1219/2442] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:04.506932 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.519417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2144aa-3b79-4588-bda8-00698a83d812 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.524682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.525402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.525750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.526092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.529140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.529140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.561094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1224/2443] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:14:04 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:14:04.565805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.582615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce74d1-5e7e-48cc-a5e8-b642c22a30a5 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.646487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:04.675489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.676125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.676405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.676675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.677817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.679727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.718341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1220/2444] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:14:04 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:14:04.719834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.741144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69bbb6-a508-4140-bc1a-249cbe211656 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.747378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.748000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.748279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.748569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.749216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.750933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.766606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1225/2445] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:14:04.767514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.784745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7eea80-4741-4bcb-b29d-71ef0e25f27b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.790750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.791522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.791802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.792076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] PATH_INFO: `/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644/users/74fd708728f54f80b21f2fe84a8e4326/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.825695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f2a9c3f8f64f05a5fd11ddf2903644, user_id=74fd708728f54f80b21f2fe84a8e4326, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.828537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.858665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1221/2446] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:04 2022] PUT /identity/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644/users/74fd708728f54f80b21f2fe84a8e4326/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:14:04.860512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.872366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6aa84-0149-460c-9d7b-a6e430ba5653 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.943143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.943781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.944062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.944333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.944978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.946696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7ed27-5c50-4f42-9d0c-93fbeff4b5f6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.957374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1226/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:14:04.961644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:04.973548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f3077-1b14-4690-b567-2e00860a1270 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:04.980519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:04.981190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:04.981475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:04.981753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] PATH_INFO: `/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644/users/74fd708728f54f80b21f2fe84a8e4326/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:04.983707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f2a9c3f8f64f05a5fd11ddf2903644, user_id=74fd708728f54f80b21f2fe84a8e4326, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:04.986395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c7105-7f86-4638-801d-0196d82f1c9a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:04.997733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1222/2448] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:04 2022] PUT /identity/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644/users/74fd708728f54f80b21f2fe84a8e4326/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:05.764478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:05.765013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:05.765359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:05.809532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] MFA Rules not processed for user `74fd708728f54f80b21f2fe84a8e4326`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:05.811367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:05.833028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:05.922453 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1227/2449] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:05.932257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:05.933125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:05.933575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:05.965057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] MFA Rules not processed for user `68f33fe618f64d06b89c3350dfc73b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:05.966842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:06.071297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1223/2450] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:06.088774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:06.090680 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:06.197125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b984f-f7d5-45b3-8f4f-aa9954052df1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:06.203824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:06.204510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:06.204869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:06.205211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:06.218527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:06.220729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f745f-f4e4-411e-ac8f-9a198a2dacae service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:06.233541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1228/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:16.058015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=46,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:16.228022 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=55 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:17.959864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:17.961391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:18.074582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c482-ffcb-413f-98ed-ab57aa0b119e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:18.079999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:18.080788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:18.081085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:18.081381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:18.083773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:18.097782 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:18.099511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:18.111243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1224/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:23.218427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:23.218990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:23.218990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:23.239854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:23.241068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:23.297885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1229/2453] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:23.310290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:23.311693 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:23.383202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d626d7-d5d9-458a-8a8e-8298d3a45036 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:23.388995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:23.389629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:23.389909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:23.390189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:23.399048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:23.401410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:23.412082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1225/2454] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:14:33.236573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:33.238038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:33.332494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd123c-411d-4094-bb17-48b4844c31d5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:33.336094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:33.337301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:33.337581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:33.337854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:33.347808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:33.349248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:33.359961 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1230/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:33.408276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=73 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:43.355079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=60 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:54.987373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:55.082772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1e9c-e22d-4dfc-b8ba-f65338759960 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:55.087528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:55.088341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:55.088468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:55.088712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] PATH_INFO: `/v3/users/68f33fe618f64d06b89c3350dfc73b34` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:55.089872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f33fe618f64d06b89c3350dfc73b34)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:55.092118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:55.145614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f33fe618f64d06b89c3350dfc73b34'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.146324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f33fe618f64d06b89c3350dfc73b34'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.154597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f33fe618f64d06b89c3350dfc73b34'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.168644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f33fe618f64d06b89c3350dfc73b34'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.169428 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f33fe618f64d06b89c3350dfc73b34'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.184311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1226/2456] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:14:54 2022] DELETE /identity/v3/users/68f33fe618f64d06b89c3350dfc73b34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:55.365893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:55.380328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1d05-380a-49d2-a22e-a5d14a2ac636 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:55.441333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:55.441977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:55.442279 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:55.442562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] PATH_INFO: `/v3/projects/22f7a43206bc42e98323ff3019bef255` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:55.443706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f7a43206bc42e98323ff3019bef255)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:55.445647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:55.502024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f7a43206bc42e98323ff3019bef255', 'request_id': 'req-536b9971-6b4c-43d1-91e9-acaaf69ae70d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.508767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f7a43206bc42e98323ff3019bef255', 'request_id': 'req-536b9971-6b4c-43d1-91e9-acaaf69ae70d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.518708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f7a43206bc42e98323ff3019bef255', 'request_id': 'req-536b9971-6b4c-43d1-91e9-acaaf69ae70d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.531364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] The token cache is being invalidate because project 22f7a43206bc42e98323ff3019bef255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:14:55.531659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.532339 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.533887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1231/2457] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:14:55 2022] DELETE /identity/v3/projects/22f7a43206bc42e98323ff3019bef255 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:55.538411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:55.539869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:55.559009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120387c8-684a-4731-92a9-6cd7396c1b9a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:55.639843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:55.640493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:55.640773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:55.641045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] PATH_INFO: `/v3/users/74fd708728f54f80b21f2fe84a8e4326` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:55.642283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fd708728f54f80b21f2fe84a8e4326)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:55.644246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:55.670571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:55.699054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fd708728f54f80b21f2fe84a8e4326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.703588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fd708728f54f80b21f2fe84a8e4326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.713871 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fd708728f54f80b21f2fe84a8e4326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.731899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fd708728f54f80b21f2fe84a8e4326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.732707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fd708728f54f80b21f2fe84a8e4326'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:55.755001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1227/2458] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:14:55 2022] DELETE /identity/v3/users/74fd708728f54f80b21f2fe84a8e4326 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:55.859451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:55.860921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:55.959847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b9971-6b4c-43d1-91e9-acaaf69ae70d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:55.987272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:55.989267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.018493 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:56.057175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.057935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.058309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.058666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.060593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.083176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdcf52-69f2-437f-b3cc-165b0cf71406 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.091074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.091870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.092162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.092436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] PATH_INFO: `/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.093678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f2a9c3f8f64f05a5fd11ddf2903644)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.095669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.133563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.136696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8031b7d-1967-455c-8f79-33f574a83169 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.148859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1232/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:56.154557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f2a9c3f8f64f05a5fd11ddf2903644', 'request_id': 'req-97aafc29-5ba0-44e1-b235-5ef3aafe6854'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:56.164496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f2a9c3f8f64f05a5fd11ddf2903644', 'request_id': 'req-97aafc29-5ba0-44e1-b235-5ef3aafe6854'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:56.172305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f2a9c3f8f64f05a5fd11ddf2903644', 'request_id': 'req-97aafc29-5ba0-44e1-b235-5ef3aafe6854'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:56.184705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] The token cache is being invalidate because project c2f2a9c3f8f64f05a5fd11ddf2903644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:14:56.184991 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:56.185686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-97aafc29-5ba0-44e1-b235-5ef3aafe6854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:14:56.187296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1228/2460] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:14:55 2022] DELETE /identity/v3/projects/c2f2a9c3f8f64f05a5fd11ddf2903644 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:56.193566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.194278 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.194917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.223628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:56.224925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.294107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1233/2461] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:56.302189 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.302516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.302797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.325880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:56.327191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.338404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1229/2462] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:56.345839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.365089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc726f-e7dd-4fa1-b56f-c799aff251aa None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.372845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.373510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.374096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.374096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.375302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:14:56.375637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.377485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.398843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1234/2463] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:14:56.403366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.413735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a1b1e-37df-4a14-8f7e-785ececa8218 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.418951 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.419475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.419753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.420031 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.420673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.422708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.449726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:56.457489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1230/2464] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:14:56 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:14:56.464914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.479473 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232908-056a-4b7d-93c9-a12864827829 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.552373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.553398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.553865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.554269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.555313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.557863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.571309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:14:56.592478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1235/2465] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:14:56 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:14:56.598502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.610208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3561b2-a055-44fe-bf41-91459c6f6cb1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.616946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.617801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.618140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.618650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.619689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.622569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.639366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1231/2466] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:14:56.644250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.656973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a007-0f65-4057-ba51-0b8df22b76c0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.662169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.662872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.663143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.663402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.664070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.665778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c53023-d49a-4738-985c-bf8d12e84ca0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.678448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1236/2467] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:14:56.683836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.718949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221d0d-8f8d-48a2-bc3a-547d6b34faae admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.727497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.728312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.728708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.729177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] PATH_INFO: `/v3/projects/7620ce2415ad41b2b219314e664d1c77/users/997df53b467c4e24b8d5d14a493b33ab/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.747235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620ce2415ad41b2b219314e664d1c77, user_id=997df53b467c4e24b8d5d14a493b33ab, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.750016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:56.771150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1232/2468] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:14:56 2022] PUT /identity/v3/projects/7620ce2415ad41b2b219314e664d1c77/users/997df53b467c4e24b8d5d14a493b33ab/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:14:56.778428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7eb07-ce93-4af5-993f-59cd6da9ef01 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.779014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7eb07-ce93-4af5-993f-59cd6da9ef01 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.779547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7eb07-ce93-4af5-993f-59cd6da9ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.809125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4ee7eb07-ce93-4af5-993f-59cd6da9ef01 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:56.810418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ee7eb07-ce93-4af5-993f-59cd6da9ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.893726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1237/2469] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:14:56.904990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:56.907279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:56.977740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d331-e477-4c6b-907b-b00471e609f3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:56.982373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:56.983019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:56.983306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:56.983727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:56.993934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:56.995445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:57.006463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1233/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:14:58.076370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941730-e198-4415-8a50-3df686a16931 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:58.077214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941730-e198-4415-8a50-3df686a16931 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:58.077214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941730-e198-4415-8a50-3df686a16931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:58.121600 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d941730-e198-4415-8a50-3df686a16931 None None] MFA Rules not processed for user `997df53b467c4e24b8d5d14a493b33ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:14:58.123954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d941730-e198-4415-8a50-3df686a16931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:58.241970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1238/2471] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:14:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:14:58.249928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:14:58.251689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:14:58.347699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a99f9-9574-4630-94ba-2ebcb7f11ee3 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:14:58.351943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:14:58.352855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:14:58.353718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:14:58.353987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:14:58.363955 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:14:58.365898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:14:58.377451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1234/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:14:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:00.093216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:00.093797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:00.094200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:00.142054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] MFA Rules not processed for user `997df53b467c4e24b8d5d14a493b33ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:00.143381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:00.175905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1239/2473] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:00.499533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:00.503269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:00.549603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23ae8-9af8-4441-92a2-53834c81892b service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:00.558546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:00.559482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:00.559890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:00.560269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] PATH_INFO: `/v3/users/5a424b3a933741549c26a4ffc5ecaf93` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:00.561898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a424b3a933741549c26a4ffc5ecaf93)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:00.564219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:00.655200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a424b3a933741549c26a4ffc5ecaf93'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:00.656415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a424b3a933741549c26a4ffc5ecaf93'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:00.673502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a424b3a933741549c26a4ffc5ecaf93'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:00.691356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:00.703246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a424b3a933741549c26a4ffc5ecaf93'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:00.704966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-92039214-ae56-4e63-b169-bb4fedfbb785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a424b3a933741549c26a4ffc5ecaf93'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:00.760010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1235/2474] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:00 2022] DELETE /identity/v3/users/5a424b3a933741549c26a4ffc5ecaf93 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:01.137846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.185375 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913a597-5b81-42fb-b44b-2d13e51ca2f4 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.280628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.281394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.282075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.282364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] PATH_INFO: `/v3/projects/87b398e61c694a2ba863a48edf6ea4ed` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.283693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b398e61c694a2ba863a48edf6ea4ed)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.285813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.295487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:01.356152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b398e61c694a2ba863a48edf6ea4ed', 'request_id': 'req-235c558e-a6e2-46b4-8c0a-3ef1a65263de'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:01.365927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b398e61c694a2ba863a48edf6ea4ed', 'request_id': 'req-235c558e-a6e2-46b4-8c0a-3ef1a65263de'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:01.378076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b398e61c694a2ba863a48edf6ea4ed', 'request_id': 'req-235c558e-a6e2-46b4-8c0a-3ef1a65263de'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:01.397053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] The token cache is being invalidate because project 87b398e61c694a2ba863a48edf6ea4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:01.397418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:01.398505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-235c558e-a6e2-46b4-8c0a-3ef1a65263de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:01.400297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1240/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:01 2022] DELETE /identity/v3/projects/87b398e61c694a2ba863a48edf6ea4ed => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:01.406037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.406476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.406902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.436412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:01.438726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:01.531037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1236/2476] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:01.539538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45911-5653-4206-9524-61a114bac213 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.539538 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45911-5653-4206-9524-61a114bac213 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.540100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45911-5653-4206-9524-61a114bac213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.564452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bbd45911-5653-4206-9524-61a114bac213 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:01.565733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bbd45911-5653-4206-9524-61a114bac213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:01.582546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1241/2477] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:01.587754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.600570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5a363-d0c6-42b8-83d9-13cc0e036aa9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.606724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.607593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.607874 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.608149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.608830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:01.609135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.611058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.627836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1237/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:01.633072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45911-5653-4206-9524-61a114bac213 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.646917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd45911-5653-4206-9524-61a114bac213 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.659511 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.660482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.660902 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.661617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.663209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.667337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.718153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1242/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:01 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:01.723243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.735083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516552b-3c44-4346-bfd5-480fac54226c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.830138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.831256 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.831771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.832283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.833495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.837860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.868384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1238/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:01 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:01.873221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.889477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab55ee-187a-4b75-83ab-5f1e1b1004dd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.895976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.896643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.896925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.897206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.897907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.909239 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.932385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1243/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:01.938329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:01.957958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b319c13-f647-476d-84b0-54d4a17c9619 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:01.964069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:01.964801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:01.965163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:01.965804 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:01.966590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:01.968457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06345c7e-a303-4931-b8be-a5cd7dac5409 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:01.984879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1239/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:01.990514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.012768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37867db-c72a-4300-a9eb-d8bf12dadde7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.020365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.021065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.021350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.021630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] PATH_INFO: `/v3/projects/92f9c7179ce14558bdbbb82ecac0d5f6/users/a9e93be0b66a40caa0033acf57d8faff/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.040013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f9c7179ce14558bdbbb82ecac0d5f6, user_id=a9e93be0b66a40caa0033acf57d8faff, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.043470 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.061169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1244/2483] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:01 2022] PUT /identity/v3/projects/92f9c7179ce14558bdbbb82ecac0d5f6/users/a9e93be0b66a40caa0033acf57d8faff/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:02.073757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f192-87d3-4460-adb5-af424055e32f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.074124 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f192-87d3-4460-adb5-af424055e32f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.074502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f192-87d3-4460-adb5-af424055e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.110130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1066f192-87d3-4460-adb5-af424055e32f None None] MFA Rules not processed for user `a9e93be0b66a40caa0033acf57d8faff`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:02.111943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1066f192-87d3-4460-adb5-af424055e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:02.158751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:02.195903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1240/2484] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:02.201757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.285715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845769-11e9-4684-ad9d-5974be090731 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.293362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.295175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.295175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.295175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.296668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.298940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.355360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1245/2485] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:02 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:02.357113 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f192-87d3-4460-adb5-af424055e32f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.384841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f192-87d3-4460-adb5-af424055e32f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.485780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.487981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.488328 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.488648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.489771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.492323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.524347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1241/2486] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:02 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:02.528733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.541335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11bc8-e07f-49a2-b118-3d3f95a6b194 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.546697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.547436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.548025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.548246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.548940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.550691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.564202 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1246/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:02.568819 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.584517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b875e6-d9ef-47cd-95a9-8a9d2b7a725a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.595109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.595974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.596456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.596940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] PATH_INFO: `/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f/users/97f798db4de54f60815285ffd2446620/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.624533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b8b3b407c04c49a88bd0e5bcc7185f, user_id=97f798db4de54f60815285ffd2446620, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.627466 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.648036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1242/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:02 2022] PUT /identity/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f/users/97f798db4de54f60815285ffd2446620/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:02.652985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.663579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488783-584e-42ef-bd33-c04362176199 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.667731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:02.748152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.748822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.749073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.749352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.750041 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.751726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd739a4-129c-4071-b908-c001b7e697f9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.763873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1247/2489] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:02.771418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:02.791210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d07fb-46d9-46b3-a188-a91bba4bc7c0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:02.800760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:02.802150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.802711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.803184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] PATH_INFO: `/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f/users/97f798db4de54f60815285ffd2446620/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.807193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b8b3b407c04c49a88bd0e5bcc7185f, user_id=97f798db4de54f60815285ffd2446620, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:02.812447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:02.832968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1243/2490] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:02 2022] PUT /identity/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f/users/97f798db4de54f60815285ffd2446620/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:02.852424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:02.852696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:02.853419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:02.889204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] MFA Rules not processed for user `97f798db4de54f60815285ffd2446620`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:02.890534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:02.982503 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1248/2491] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:03.000405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:03.004279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:03.108942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57236a43-7a74-4252-8cd9-69c6bff7545e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:03.112739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:03.113527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:03.113881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:03.114222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:03.125924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:03.127559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:03.139520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1244/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:03.269725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:03.292654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b3fe-5cdb-4e86-9dba-f583fc8166aa None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:03.297529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:03.298509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:03.299118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:03.299442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:03.405673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:03.409488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cc7ca-e5b3-4f82-8c1d-eb95e9f8fd82 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:03.428834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1249/2493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:11.271455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:11.309613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:11.341266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e03f7-b6f8-45ae-b640-369dd553e60f service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:11.346367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:11.346950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:11.347243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:11.347522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] PATH_INFO: `/v3/users/a9e93be0b66a40caa0033acf57d8faff` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:11.348787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e93be0b66a40caa0033acf57d8faff)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:11.350849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:11.402364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e93be0b66a40caa0033acf57d8faff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:11.403013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e93be0b66a40caa0033acf57d8faff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:11.410618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e93be0b66a40caa0033acf57d8faff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:11.430136 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e93be0b66a40caa0033acf57d8faff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:11.431517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e93be0b66a40caa0033acf57d8faff'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:11.449729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1245/2494] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:11 2022] DELETE /identity/v3/users/a9e93be0b66a40caa0033acf57d8faff => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:11.454193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:11.454728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:11.454728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:11.474427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:11.475827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:11.504662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:11.559205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1250/2495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:11.570304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:11.572616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:11.644422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccfec-9b59-4d91-908f-2cef4ef23d3c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:11.648158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:11.648775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:11.649057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:11.649359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:11.658531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:11.659981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:11.670067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1246/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:11.946094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:11.947590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:11.969823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8a44-fba5-4d93-9957-c22ea6df64f7 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:11.974746 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:11.975447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:11.975676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:11.975950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] PATH_INFO: `/v3/projects/92f9c7179ce14558bdbbb82ecac0d5f6` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:11.977111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f9c7179ce14558bdbbb82ecac0d5f6)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:11.980048 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:12.028153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f9c7179ce14558bdbbb82ecac0d5f6', 'request_id': 'req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.034510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f9c7179ce14558bdbbb82ecac0d5f6', 'request_id': 'req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.043104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f9c7179ce14558bdbbb82ecac0d5f6', 'request_id': 'req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.054761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] The token cache is being invalidate because project 92f9c7179ce14558bdbbb82ecac0d5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:12.055055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.055743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.057295 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1251/2497] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:11 2022] DELETE /identity/v3/projects/92f9c7179ce14558bdbbb82ecac0d5f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:12.061324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:12.071046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2d2f-5d2e-4dd2-a428-39913dc1ea2d service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:12.122138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:12.129315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:12.130343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.130617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.130939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] PATH_INFO: `/v3/users/97f798db4de54f60815285ffd2446620` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.132203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f798db4de54f60815285ffd2446620)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:12.134775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:12.186885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f798db4de54f60815285ffd2446620'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.187535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f798db4de54f60815285ffd2446620'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.194668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f798db4de54f60815285ffd2446620'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.206753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f798db4de54f60815285ffd2446620'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.207441 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c5faf7b-b1e0-445e-8b25-75954cff3451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f798db4de54f60815285ffd2446620'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.220920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1247/2498] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:12 2022] DELETE /identity/v3/users/97f798db4de54f60815285ffd2446620 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:12.512074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:12.513989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:12.530880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad281b3-e004-4e1e-a0cd-e4beb7526b04 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:12.600021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:12.601115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.601115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.601310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] PATH_INFO: `/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.602350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b8b3b407c04c49a88bd0e5bcc7185f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:12.604286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:12.663412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b8b3b407c04c49a88bd0e5bcc7185f', 'request_id': 'req-423d31e8-86a4-40b5-b07c-4e2ef4871978'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.666702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:12.684045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b8b3b407c04c49a88bd0e5bcc7185f', 'request_id': 'req-423d31e8-86a4-40b5-b07c-4e2ef4871978'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.684045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b8b3b407c04c49a88bd0e5bcc7185f', 'request_id': 'req-423d31e8-86a4-40b5-b07c-4e2ef4871978'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.708976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] The token cache is being invalidate because project 84b8b3b407c04c49a88bd0e5bcc7185f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:12.708976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.710064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-423d31e8-86a4-40b5-b07c-4e2ef4871978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:12.712829 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1252/2499] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:12 2022] DELETE /identity/v3/projects/84b8b3b407c04c49a88bd0e5bcc7185f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:12.717976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.718444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.718645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.738963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:12.740378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:12.814182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1248/2500] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:12.822730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.823020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.823294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.844980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:12.846513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:12.854739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1253/2501] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:12.859288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:12.872217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375866f-23c1-4d13-b57e-4098adc893a1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:12.877313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:12.878208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.878620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.879058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.882427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:12.882427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:12.882427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:12.904434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1249/2502] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:15:12.912964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:12.922778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38eee-26f8-49e0-882c-c6a7eb027323 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:12.927934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:12.928450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:12.928733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:12.929008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:12.929656 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:12.932129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:12.966350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1254/2503] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:12 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:12.970977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:12.982803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38f055-5a38-4b51-b4a3-77562a650963 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.059799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.060561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.060846 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.061125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.061765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.063777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.074872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:13.092987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1250/2504] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:12 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:13.095860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.109642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e734-c65e-48ed-b035-fa17adca2e95 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.123938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.124581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.124864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.125138 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.125802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.128005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.144234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1255/2505] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:13.145562 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.155967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576e3-2e28-4eba-a35a-c89229fbad4f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.162589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.163146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.163426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.163701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.164323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.166447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb3c3-77ec-4516-b031-3fb756e03d90 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.178392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1251/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:13.187268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.198126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d047e5-8e97-47da-9215-2da2c6c72ea1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.203197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.204076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.204355 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.204629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] PATH_INFO: `/v3/projects/c919436dec984c1c847ad5ed16f7d3fb/users/913a579a03684204a263fbede60af7bd/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.220002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c919436dec984c1c847ad5ed16f7d3fb, user_id=913a579a03684204a263fbede60af7bd, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.222676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.239266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1256/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:13 2022] PUT /identity/v3/projects/c919436dec984c1c847ad5ed16f7d3fb/users/913a579a03684204a263fbede60af7bd/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:13.251581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.251972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.252254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.282547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] MFA Rules not processed for user `913a579a03684204a263fbede60af7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:13.283817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:13.358053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1252/2508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:13.359271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.445827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd80e5a-33e5-4e9d-850c-24b1e31692c8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.452709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.454614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.455035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.455211 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.456290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.459741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.500598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1257/2509] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:13 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:13.504117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.518520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47b7c-78e5-4082-be74-682c0b22cc0c None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.590374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.591247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.591553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.591875 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.592508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.594518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.616699 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1253/2510] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:13 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:13.621118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.631636 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1739b-7f38-46bd-9960-69deb66fc503 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.636980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.637616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.637897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.638170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.638851 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.640443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.653196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1258/2511] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:13.657661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.668526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f147a-2e34-4c6d-8817-0ee11bd16292 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.673331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.673935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.674214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.674672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] PATH_INFO: `/v3/projects/86b0d61bba3e4b8c867c28183b42a371/users/78434873670a420e9b8f030926deceee/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.691574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b0d61bba3e4b8c867c28183b42a371, user_id=78434873670a420e9b8f030926deceee, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.694382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.709628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1254/2512] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:13 2022] PUT /identity/v3/projects/86b0d61bba3e4b8c867c28183b42a371/users/78434873670a420e9b8f030926deceee/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:13.715058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.726586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef573769-3392-41a7-ba41-595f01f9643f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.779876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:13.794789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.795484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.795793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.796105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.796895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.798831 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c99c0f-c408-4bdb-8c76-412ce410b13d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.809195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1259/2513] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:13.813490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.824157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559ae2-131b-4794-a6e0-cf129a4341d0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:13.835014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:13.835706 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.835984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.836258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] PATH_INFO: `/v3/projects/86b0d61bba3e4b8c867c28183b42a371/users/78434873670a420e9b8f030926deceee/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.838795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b0d61bba3e4b8c867c28183b42a371, user_id=78434873670a420e9b8f030926deceee, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:13.842107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:13.854005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1255/2514] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:13 2022] PUT /identity/v3/projects/86b0d61bba3e4b8c867c28183b42a371/users/78434873670a420e9b8f030926deceee/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:13.864193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:13.864478 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:13.864751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:13.892841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] MFA Rules not processed for user `78434873670a420e9b8f030926deceee`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:13.894111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:13.964889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1260/2515] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:13.976096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:13.977844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:14.003157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:14.036744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9efe1-1c3f-4514-bba2-a78dde4ba126 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:14.040393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:14.041020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:14.041296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:14.041646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:14.050556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:14.051977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:14.061238 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1256/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:14.139736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:14.149614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc31bf-eca3-4249-add5-4b7d50f6ab94 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:14.153846 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:14.154482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:14.154764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:14.155038 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:14.214110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:14.215897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f142f01-0156-4880-96cf-98e19c33c6ac service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:14.225344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1261/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:16.988009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:17.057864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ca73f-75dc-430f-a131-923045ed604e service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:17.062791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:17.063549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:17.063904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:17.064247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] PATH_INFO: `/v3/users/913a579a03684204a263fbede60af7bd` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:17.065497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913a579a03684204a263fbede60af7bd)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:17.067681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:17.131841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913a579a03684204a263fbede60af7bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:17.132543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913a579a03684204a263fbede60af7bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:17.141034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913a579a03684204a263fbede60af7bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:17.155604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913a579a03684204a263fbede60af7bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:17.156482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913a579a03684204a263fbede60af7bd'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:17.183315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1257/2518] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:16 2022] DELETE /identity/v3/users/913a579a03684204a263fbede60af7bd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:17.184251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:17.184699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:17.184799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:17.189164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:17.189164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:17.211586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:17.213400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:17.241933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:17.255629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff07a-fad1-4a71-929b-b4e577a9c5f6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:17.260663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:17.261284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:17.261574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:17.261852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:17.264789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:17.284457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1262/2519] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:17.294082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:17.304597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729687a-8dbb-4da5-805a-4b8b0895ded9 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:17.309017 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:17.309750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:17.310034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:17.310354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:17.320803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:17.322882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:17.327065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:17.335300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1263/2520] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:17.343903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:17.345334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:17.355728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1258/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:17.926120 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:17.927968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:17.949055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94060-f1c5-465d-961d-8d463a625c63 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:17.959276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:17.960402 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:17.960906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:17.961414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] PATH_INFO: `/v3/projects/c919436dec984c1c847ad5ed16f7d3fb` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:17.971240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c919436dec984c1c847ad5ed16f7d3fb)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:17.973210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:18.029667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c919436dec984c1c847ad5ed16f7d3fb', 'request_id': 'req-9a8a190a-3442-421e-9b6b-149032e87139'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.036758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c919436dec984c1c847ad5ed16f7d3fb', 'request_id': 'req-9a8a190a-3442-421e-9b6b-149032e87139'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.045744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c919436dec984c1c847ad5ed16f7d3fb', 'request_id': 'req-9a8a190a-3442-421e-9b6b-149032e87139'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.058790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] The token cache is being invalidate because project c919436dec984c1c847ad5ed16f7d3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:18.059089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.059792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.062314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1264/2522] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:17 2022] DELETE /identity/v3/projects/c919436dec984c1c847ad5ed16f7d3fb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:18.065408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:18.076133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350dfa8-0fc8-4512-812f-804e9a2cb2ca service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:18.150117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:18.151180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.151611 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.152286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] PATH_INFO: `/v3/users/78434873670a420e9b8f030926deceee` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.154236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78434873670a420e9b8f030926deceee)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:18.157642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:18.230176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78434873670a420e9b8f030926deceee'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.230905 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78434873670a420e9b8f030926deceee'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.238469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78434873670a420e9b8f030926deceee'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.253093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78434873670a420e9b8f030926deceee'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.254012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-989244ea-a6c2-4251-bc84-8c9b992e8047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78434873670a420e9b8f030926deceee'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.268556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1259/2523] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:18 2022] DELETE /identity/v3/users/78434873670a420e9b8f030926deceee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:18.578129 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:18.579715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:18.597973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a190a-3442-421e-9b6b-149032e87139 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:18.666378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:18.667283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.667405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.667854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] PATH_INFO: `/v3/projects/86b0d61bba3e4b8c867c28183b42a371` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.668853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b0d61bba3e4b8c867c28183b42a371)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:18.671031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:18.745115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b0d61bba3e4b8c867c28183b42a371', 'request_id': 'req-4bcc826e-befa-43f0-9e7a-7a1333ad5128'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.754315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b0d61bba3e4b8c867c28183b42a371', 'request_id': 'req-4bcc826e-befa-43f0-9e7a-7a1333ad5128'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.766214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b0d61bba3e4b8c867c28183b42a371', 'request_id': 'req-4bcc826e-befa-43f0-9e7a-7a1333ad5128'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.780647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] The token cache is being invalidate because project 86b0d61bba3e4b8c867c28183b42a371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:18.780988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.781733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4bcc826e-befa-43f0-9e7a-7a1333ad5128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:18.783706 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1265/2524] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:18 2022] DELETE /identity/v3/projects/86b0d61bba3e4b8c867c28183b42a371 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:18.789188 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.789544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.789895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.811881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:18.813221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:18.826489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:18.890179 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1260/2525] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:18.899394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.899730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.900076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.921024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:18.922403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:18.931111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1266/2526] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:18.935471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:18.945546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b07e2d-6f69-434b-a096-031319fcf751 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:18.951003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:18.951615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.951895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.952171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.952821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:18.953148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:18.954787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:18.966757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1261/2527] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:18.971231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:18.977320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:18.981598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ee710-80d0-42fa-865d-8c004d1e102f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:18.988084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:18.988734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:18.989443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:18.989743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:18.990742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:18.992834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.022348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1267/2528] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:19.026773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.037150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33b2c-9217-4e73-838c-1efedc3c9372 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.095353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.096023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.096285 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.096563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.097203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.099311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.122311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1262/2529] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:19 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:19.126319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.138993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2fe5-7b78-49f6-b50a-b06dbafc1d04 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.142911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.143533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.143813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.144136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.144725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.146475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.165635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1268/2530] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:19.167117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.177799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce4d79-8507-47da-b289-9872dcdefa10 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.183545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.184260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.184541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.184809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.185445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.187138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf4a7e-e815-45f6-b654-f5de11a079a0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.199800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1263/2531] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:19.206951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.218517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b162e9-43cd-4946-bae0-6383c48f8caf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.223663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.224395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.224812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.225100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] PATH_INFO: `/v3/projects/c99268d774ea4a1b9019b698d02646f1/users/781ba571ce934078a5af2c1881a5753b/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.244400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99268d774ea4a1b9019b698d02646f1, user_id=781ba571ce934078a5af2c1881a5753b, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.246766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.263092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1269/2532] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:19 2022] PUT /identity/v3/projects/c99268d774ea4a1b9019b698d02646f1/users/781ba571ce934078a5af2c1881a5753b/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:19.273335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.273998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.274396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.307157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] MFA Rules not processed for user `781ba571ce934078a5af2c1881a5753b`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:19.308647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:19.378749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1264/2533] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:19.384190 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.599834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaeacb-3b25-45ff-8d7a-6bf6db58afaf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.605934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.606684 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.607037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.607383 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.608573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.611464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.659320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1270/2534] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:19 2022] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:19.663130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.680336 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e86f5-f3ed-4f2e-9af0-415f1abef435 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.689493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:19.760303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.760303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.760303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.760303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.760757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.762275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.789333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1265/2535] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:19 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:19.791180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.807382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b3f-1ed5-498e-982b-2464fe89fa75 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.813065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.813723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.813999 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.814303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.814964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.816717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.831171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1271/2536] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:19.832613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.844352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ac320-9d28-4e26-8716-231d11f0373a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.849156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.849897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.850190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.850513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] PATH_INFO: `/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66/users/3e95453643ff4b6993845aaf248c6152/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.868946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7468dc5eba4640d2b9b94ad3db41fb66, user_id=3e95453643ff4b6993845aaf248c6152, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.871753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.887631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1266/2537] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:19 2022] PUT /identity/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66/users/3e95453643ff4b6993845aaf248c6152/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:19.892574 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:19.910940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb02a-6b6d-4286-b540-cf65e8de859d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:19.974409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:19.975139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:19.975494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:19.975837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:19.976561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:19.978231 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16269d51-b041-45f7-8fb3-0d2f44ac1c3f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:19.988615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1272/2538] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:19.992812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:20.006824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450395-27c1-4b56-ad71-1886f6fc035d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:20.012892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:20.013353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:20.013623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:20.013900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] PATH_INFO: `/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66/users/3e95453643ff4b6993845aaf248c6152/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:20.016162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7468dc5eba4640d2b9b94ad3db41fb66, user_id=3e95453643ff4b6993845aaf248c6152, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:20.018864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:20.034290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1267/2539] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:19 2022] PUT /identity/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66/users/3e95453643ff4b6993845aaf248c6152/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:20.043710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:20.044055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:20.044888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:20.080156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] MFA Rules not processed for user `3e95453643ff4b6993845aaf248c6152`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:20.081531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:20.087934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:20.186832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1273/2540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:20.199134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:20.201604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:20.282658 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a3ad-47ec-4897-a07b-c9eecc84ecf2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:20.286942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:20.287649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:20.288011 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:20.288357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:20.388712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:20.390498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:20.421943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1268/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:21.259884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:21.261634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:21.357668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3e2c-9668-4314-b121-4f5d3083fd16 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:21.363205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:21.363871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:21.364180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:21.364461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] PATH_INFO: `/v3/users/1587552a5e6d47f0af519679a08f7300` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:21.365663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1587552a5e6d47f0af519679a08f7300)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:21.367692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:21.430379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1587552a5e6d47f0af519679a08f7300'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.431035 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1587552a5e6d47f0af519679a08f7300'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.439632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1587552a5e6d47f0af519679a08f7300'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.454446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1587552a5e6d47f0af519679a08f7300'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.455245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d5db8c3e-e5af-4eac-b3ca-16eb4abf6cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1587552a5e6d47f0af519679a08f7300'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.475472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1274/2542] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:21 2022] DELETE /identity/v3/users/1587552a5e6d47f0af519679a08f7300 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:21.670965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:21.683803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fa87-68ac-4a5d-8b9a-397e129da25c service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:21.698062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:21.761445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:21.762120 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:21.762440 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:21.762724 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] PATH_INFO: `/v3/projects/fbc45b3c42e44f41b02fd4e3035719f3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:21.763976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc45b3c42e44f41b02fd4e3035719f3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:21.765938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:21.827455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc45b3c42e44f41b02fd4e3035719f3', 'request_id': 'req-43f1be0c-2314-4024-ae72-08bbd9a67da8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.837786 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc45b3c42e44f41b02fd4e3035719f3', 'request_id': 'req-43f1be0c-2314-4024-ae72-08bbd9a67da8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.846083 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc45b3c42e44f41b02fd4e3035719f3', 'request_id': 'req-43f1be0c-2314-4024-ae72-08bbd9a67da8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.860957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] The token cache is being invalidate because project fbc45b3c42e44f41b02fd4e3035719f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:21.861283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.861925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-43f1be0c-2314-4024-ae72-08bbd9a67da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:21.863469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1269/2543] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:21 2022] DELETE /identity/v3/projects/fbc45b3c42e44f41b02fd4e3035719f3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:21.869634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a9c5-94a1-498d-b0f0-0f39b8f141ce None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:21.870234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a9c5-94a1-498d-b0f0-0f39b8f141ce None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:21.870633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a9c5-94a1-498d-b0f0-0f39b8f141ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:21.906587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e782a9c5-94a1-498d-b0f0-0f39b8f141ce None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:21.908735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e782a9c5-94a1-498d-b0f0-0f39b8f141ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:21.940480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:22.015881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1275/2544] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:22.028400 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.028686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.028958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.070231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:22.073198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:22.080792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.081642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.082406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.093802 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1270/2545] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:22.095640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.116385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dce75-903e-489f-a270-5d03bc23a91a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.127109 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] MFA Rules not processed for user `997df53b467c4e24b8d5d14a493b33ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:22.129093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:22.132163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.132830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.133393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.134023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.135708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:22.137117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.142172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.171243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1271/2546] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:22.179102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.203020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97c6d-f935-4a54-89ec-cab63cdec0b4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.218378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.221168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.222025 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.223255 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.227974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.232475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.241849 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1276/2547] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:22.301971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1272/2548] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:22 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:22.314189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.328099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8361c-cb6c-4708-b00f-88c2207df046 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.438571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.439603 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.440086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.440569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.441714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.445183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.483032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1277/2549] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:22 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:22.489543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.505904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444437f-e814-4963-a278-7dc69cedc7dd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.511536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.512277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.512627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.512980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.513733 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.515623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.528117 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1273/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:22.532494 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.545386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b62eff-d0ac-4b08-bb4a-a39b32153e8b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.552762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.553731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.554130 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.554553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.555346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.557891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad440e-aae1-4710-ba4c-51118792d352 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.571411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1278/2551] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:22.577202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.590414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b34-e7c5-4884-af1b-93de2fbb6272 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.596959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.597965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.598430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.598836 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] PATH_INFO: `/v3/projects/5dce8dd8297b469f8ece4e453df9c03f/users/3f997231092c45718b905ae2bd3f7cee/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.622571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce8dd8297b469f8ece4e453df9c03f, user_id=3f997231092c45718b905ae2bd3f7cee, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.625510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.644545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1274/2552] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:22 2022] PUT /identity/v3/projects/5dce8dd8297b469f8ece4e453df9c03f/users/3f997231092c45718b905ae2bd3f7cee/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:22.657319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.657619 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.657888 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.692901 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] MFA Rules not processed for user `3f997231092c45718b905ae2bd3f7cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:22.694169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:22.746725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:22.795852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1279/2553] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:22.815234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:22.819258 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:22.871689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:22.909695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f5f5-5030-4640-a98d-5fbebb8b6835 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:22.913672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:22.914330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:22.914618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:22.914927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:22.929267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:22.930139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:22.942999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1275/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:23.457597 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:23.459193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:23.475646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcb498-efc8-497e-925c-129fa8d47bb8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:23.479427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:23.479940 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:23.480240 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:23.480570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:23.483004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:23.609796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:23.612623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:23.626429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1280/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:29.721048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:29.722573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:29.786264 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ce65-3f46-43c7-939e-204e4a7861fb service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:29.790511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:29.791128 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:29.791490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:29.791757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:29.797152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:29.891253 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:29.892740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa60112-45f3-48ac-9885-6ecacfbcd298 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:29.905945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1276/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:32.209712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:32.223726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a030a-122d-4284-92bb-ae9acb3d279c service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:32.233461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:32.234444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:32.234766 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:32.235353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] PATH_INFO: `/v3/users/3f997231092c45718b905ae2bd3f7cee` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:32.236861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f997231092c45718b905ae2bd3f7cee)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:32.239195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:32.307243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f997231092c45718b905ae2bd3f7cee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:32.308265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f997231092c45718b905ae2bd3f7cee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:32.317403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f997231092c45718b905ae2bd3f7cee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:32.332565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f997231092c45718b905ae2bd3f7cee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:32.333418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f997231092c45718b905ae2bd3f7cee'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:32.351541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1281/2557] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:32 2022] DELETE /identity/v3/users/3f997231092c45718b905ae2bd3f7cee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:32.356341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:32.356830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:32.356952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:32.378800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:32.380226 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:32.474232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1277/2558] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:32.485016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:32.486490 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:32.538521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:32.554835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd69ed-35a9-4b5f-a1c2-aa0b842bd2bc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:32.564141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:32.564838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:32.565150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:32.565627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:32.580548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:32.583118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf16ce-1fbe-46a0-8195-9955555cc7ea service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:32.597076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1282/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:32.909139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:32.911581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:32.928510 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373a967-ff18-4f27-9db4-27ee716e84e7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:32.933776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:32.934626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:32.935140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:32.935523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] PATH_INFO: `/v3/projects/5dce8dd8297b469f8ece4e453df9c03f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:32.936841 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dce8dd8297b469f8ece4e453df9c03f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:32.938904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:32.957748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:33.035451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dce8dd8297b469f8ece4e453df9c03f', 'request_id': 'req-21089ac5-269a-4f78-8e69-e70b81d1bbb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:33.052107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dce8dd8297b469f8ece4e453df9c03f', 'request_id': 'req-21089ac5-269a-4f78-8e69-e70b81d1bbb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:33.075297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dce8dd8297b469f8ece4e453df9c03f', 'request_id': 'req-21089ac5-269a-4f78-8e69-e70b81d1bbb8'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:33.098299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] The token cache is being invalidate because project 5dce8dd8297b469f8ece4e453df9c03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:33.098919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:33.100906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-21089ac5-269a-4f78-8e69-e70b81d1bbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:33.104196 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1278/2560] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:32 2022] DELETE /identity/v3/projects/5dce8dd8297b469f8ece4e453df9c03f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:33.108981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.112608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.112608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.187666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:33.189184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:33.265816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1283/2561] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:33.275100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.275450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.275744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.308133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:33.309826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:33.325591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1279/2562] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:33.327827 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.341319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2986-e141-49c0-9b69-78ceee069b40 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.347381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.348276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.348654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.349031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.349863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:33.350314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.353450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.381859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1284/2563] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:33.386848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.398727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1420c9-bf25-4c62-a43e-d6c8a170d604 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.407084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.407998 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.408439 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.408880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.409727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.412069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.479180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1280/2564] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:33.484396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.500696 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5924f-f289-471b-9413-ab2f88d34b38 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.599413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.600133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.600485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.600826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.601563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.610537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.647396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1285/2565] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:33 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:33.651606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.674559 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cf2d2-cbb7-4c5a-8466-04eb432977c5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.687942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.689150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.689742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.690257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.691296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.693812 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.706993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1281/2566] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:33.718550 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.758947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3a059-cd44-470f-9359-ed6f36beab12 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.791259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.792032 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.802408 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.802776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.803546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.805280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75e7a-1c47-412c-9f56-1b3df50ed3b1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.821547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1286/2567] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:33.826088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:33.839588 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352934f-f9a7-4fdf-810a-41280823d16c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:33.857391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:33.858436 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.858960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.859525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] PATH_INFO: `/v3/projects/7310e2cbf5f443a896828e5e2e40f678/users/98422dc9638e4e32813f522af60afd7e/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.887067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7310e2cbf5f443a896828e5e2e40f678, user_id=98422dc9638e4e32813f522af60afd7e, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:33.890233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:33.907881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1282/2568] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:33 2022] PUT /identity/v3/projects/7310e2cbf5f443a896828e5e2e40f678/users/98422dc9638e4e32813f522af60afd7e/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:33.919620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:33.919907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:33.920175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:33.979886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] MFA Rules not processed for user `98422dc9638e4e32813f522af60afd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:33.983859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.041707 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:34.067591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1287/2569] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:34.072276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.141304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f531af-0930-42ec-8950-55a145fff1d4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.153837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.154524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.154807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.155079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.155727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.157651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.192785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1283/2570] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:34 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:34.198409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.209477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09fdeb-e091-4b62-8e7b-43fcb9f325c0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.277675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.278474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.278731 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.279098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.279757 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.281824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.304662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1288/2571] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:34 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:34.309566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.324306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa859-14e9-4430-8631-13233566c053 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.329872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.330919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.330919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.331187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.331862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.333469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.355101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.356281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1284/2572] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:34.368288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230df2-b82a-4a68-ab2d-6492705324af admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.379056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.381894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.388996 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.389681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.389958 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.390230 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] PATH_INFO: `/v3/projects/f0e34e49e52c407e9ca388f661a78c8d/users/f9e3d31d1131452bb46ebd107c52ad59/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.401957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158517-2894-4750-b617-e928ae10a984 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.408671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.409538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.409880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.410356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] PATH_INFO: `/v3/users/680128c3fd934178b5d8d1370bb3729f` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.411930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] RBAC: Authorizing `identity:delete_user(user_id=680128c3fd934178b5d8d1370bb3729f)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.412071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e34e49e52c407e9ca388f661a78c8d, user_id=f9e3d31d1131452bb46ebd107c52ad59, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.414596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.415057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.432303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:34.432552 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1289/2573] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:34 2022] PUT /identity/v3/projects/f0e34e49e52c407e9ca388f661a78c8d/users/f9e3d31d1131452bb46ebd107c52ad59/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:34.433544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.488731 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680128c3fd934178b5d8d1370bb3729f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:34.489775 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680128c3fd934178b5d8d1370bb3729f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:34.497897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680128c3fd934178b5d8d1370bb3729f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:34.512064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680128c3fd934178b5d8d1370bb3729f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:34.512913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680128c3fd934178b5d8d1370bb3729f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:34.515323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951ee4-86e7-4e74-8a9e-bb981a987b20 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.520551 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.521245 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.521557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.521906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.522624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.524353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce9c8a-2a10-4465-b30c-63723195331d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.531227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1285/2574] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:34 2022] DELETE /identity/v3/users/680128c3fd934178b5d8d1370bb3729f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:34.538662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1290/2575] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:34.539279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.541208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.633121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad153-a8b8-466d-8ca4-5a33a423779a admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.639647 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.640339 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.640624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.640902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] PATH_INFO: `/v3/projects/f0e34e49e52c407e9ca388f661a78c8d/users/f9e3d31d1131452bb46ebd107c52ad59/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.644191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e34e49e52c407e9ca388f661a78c8d, user_id=f9e3d31d1131452bb46ebd107c52ad59, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.648700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.664010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1286/2576] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:34 2022] PUT /identity/v3/projects/f0e34e49e52c407e9ca388f661a78c8d/users/f9e3d31d1131452bb46ebd107c52ad59/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:34.677423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.677714 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.677983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.719839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] MFA Rules not processed for user `f9e3d31d1131452bb46ebd107c52ad59`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:34.721076 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.755793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.767615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.776841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:34.905668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ad1c6-f95a-4c84-9d76-88be029d931d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:34.911294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:34.912133 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:34.912634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:34.913046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] PATH_INFO: `/v3/projects/72490f945ddb4461bce36c80faeaa059` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:34.913244 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1291/2577] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:34.916109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72490f945ddb4461bce36c80faeaa059)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:34.920532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:34.929716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:34.932509 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:34.974050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:35.015832 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72490f945ddb4461bce36c80faeaa059', 'request_id': 'req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.028531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb057c8-55cc-4ee7-84dc-e3f0755739db None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.035119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72490f945ddb4461bce36c80faeaa059', 'request_id': 'req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.045787 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72490f945ddb4461bce36c80faeaa059', 'request_id': 'req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.060455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] The token cache is being invalidate because project 72490f945ddb4461bce36c80faeaa059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:35.060822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.061662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-06057dcb-c3bf-4aa0-b02f-379814cfd0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.066334 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1287/2578] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:34 2022] DELETE /identity/v3/projects/72490f945ddb4461bce36c80faeaa059 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:35.075131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988f51-06ff-4b64-b81c-f8034f1df58e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.075408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988f51-06ff-4b64-b81c-f8034f1df58e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.075704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988f51-06ff-4b64-b81c-f8034f1df58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.100241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6e988f51-06ff-4b64-b81c-f8034f1df58e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:35.101493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6e988f51-06ff-4b64-b81c-f8034f1df58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.116218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.116917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.117195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.117465 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.119388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.174108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1288/2579] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:35.184476 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.184769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.185047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.195346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.197471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.206424 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:35.207737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1292/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:35.208145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.217494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1289/2581] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:35.221649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.233784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899148-4131-430a-95ae-3934f3b790e2 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.244703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.245326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.245599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.245867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.246560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:35.246863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.248443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.262277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1293/2582] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:35.266771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.283029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cc76-c7c5-4265-9555-8665137c5cab None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.288410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.289057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.289341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.289695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.290329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.292227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.326225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1290/2583] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:35.330420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.342296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2ae6-f0eb-4956-8288-67f7769edbef admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.365469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:35.421790 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.422617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.422918 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.423169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.423819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.425695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.453449 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1294/2584] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:35.457726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.469625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ab85-9719-47d5-8e38-6bc8a74972d0 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.476545 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.477210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.477600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.478015 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.478914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.480829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.496435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1291/2585] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:35.500466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.524057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba0a8f-7894-4a01-9182-968542693f6d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.530663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.531450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.531855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.532174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.532934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.534928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015fd4-d807-4614-a418-df7f78e9dc8f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.549778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1295/2586] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:35.554095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.566390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2198-ef97-4330-a5a2-dfe094a1c34e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.572286 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.573033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.573314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.573589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] PATH_INFO: `/v3/projects/b1f69673ae354f959653209f55c58013/users/49d67a8645de4113ba0bd3ba88ab3fab/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.590840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f69673ae354f959653209f55c58013, user_id=49d67a8645de4113ba0bd3ba88ab3fab, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.593519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.611233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1292/2587] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:35 2022] PUT /identity/v3/projects/b1f69673ae354f959653209f55c58013/users/49d67a8645de4113ba0bd3ba88ab3fab/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:35.622112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.622438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.622716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.652119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] MFA Rules not processed for user `49d67a8645de4113ba0bd3ba88ab3fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:35.653649 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.660524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.662382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.718985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:35.738872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a682b-e3cb-4634-93fe-05c2461d06c1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.744598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.745291 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.745570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.745845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] PATH_INFO: `/v3/users/98422dc9638e4e32813f522af60afd7e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.747178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98422dc9638e4e32813f522af60afd7e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.749233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:35.750567 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1296/2588] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:35.763425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.764845 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.803168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98422dc9638e4e32813f522af60afd7e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.803843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98422dc9638e4e32813f522af60afd7e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.811484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98422dc9638e4e32813f522af60afd7e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.824960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98422dc9638e4e32813f522af60afd7e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.825710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8c84d732-7bb7-4fb9-80c9-e83de7fd2822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98422dc9638e4e32813f522af60afd7e'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:35.841233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1293/2589] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:35 2022] DELETE /identity/v3/users/98422dc9638e4e32813f522af60afd7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:35.846003 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.846353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.846718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.849060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a331f-f301-4e38-afef-0e018afbd664 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:35.866430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:35.868252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.878873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:35.920125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:35.920947 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:35.921227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:35.921936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:35.924052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.930797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1294/2590] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:35.941335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:35.942842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:35.992215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:35.994789 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:36.006021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1297/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:36.008325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b33ff3-78a6-4acf-9163-24305f5d4dbf None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:36.013743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:36.014557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:36.015100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:36.015474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:36.028749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:36.030287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:36.042144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1295/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:36.501533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:36.503045 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:36.531887 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a116d-24f9-4196-affa-9e00db5fd837 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:36.539219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:36.540208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:36.540438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:36.540747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] PATH_INFO: `/v3/projects/7310e2cbf5f443a896828e5e2e40f678` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:36.542502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7310e2cbf5f443a896828e5e2e40f678)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:36.544809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:36.609441 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7310e2cbf5f443a896828e5e2e40f678', 'request_id': 'req-dc6787a5-f417-48e2-a5fd-13acd4ead91e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.618710 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7310e2cbf5f443a896828e5e2e40f678', 'request_id': 'req-dc6787a5-f417-48e2-a5fd-13acd4ead91e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.628671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7310e2cbf5f443a896828e5e2e40f678', 'request_id': 'req-dc6787a5-f417-48e2-a5fd-13acd4ead91e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.643822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] The token cache is being invalidate because project 7310e2cbf5f443a896828e5e2e40f678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:36.644176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.644842 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.646777 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1298/2593] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:36 2022] DELETE /identity/v3/projects/7310e2cbf5f443a896828e5e2e40f678 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:36.650581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:36.661567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662cb4c-19d1-4f6e-9235-3d41546fa61d service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:36.670643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:36.728460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:36.729243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:36.729528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:36.729799 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] PATH_INFO: `/v3/users/f9e3d31d1131452bb46ebd107c52ad59` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:36.731103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e3d31d1131452bb46ebd107c52ad59)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:36.733150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:36.782116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e3d31d1131452bb46ebd107c52ad59'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.783161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e3d31d1131452bb46ebd107c52ad59'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.790615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e3d31d1131452bb46ebd107c52ad59'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.803753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e3d31d1131452bb46ebd107c52ad59'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.804488 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ae501f1f-ce0e-42c7-a4c0-2deb45a48f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e3d31d1131452bb46ebd107c52ad59'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:36.818326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1296/2594] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:36 2022] DELETE /identity/v3/users/f9e3d31d1131452bb46ebd107c52ad59 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:37.105232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.106665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.121356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787a5-f417-48e2-a5fd-13acd4ead91e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.176502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:37.194448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.195106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.195391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.195722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] PATH_INFO: `/v3/projects/f0e34e49e52c407e9ca388f661a78c8d` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.197430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e34e49e52c407e9ca388f661a78c8d)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.200037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.259314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e34e49e52c407e9ca388f661a78c8d', 'request_id': 'req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.266156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e34e49e52c407e9ca388f661a78c8d', 'request_id': 'req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.275095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e34e49e52c407e9ca388f661a78c8d', 'request_id': 'req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.288222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] The token cache is being invalidate because project f0e34e49e52c407e9ca388f661a78c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:37.288632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.290604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.292246 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1299/2595] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:37 2022] DELETE /identity/v3/projects/f0e34e49e52c407e9ca388f661a78c8d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:37.296924 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ac6a-442d-4442-bb61-68934d3ca572 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.297287 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ac6a-442d-4442-bb61-68934d3ca572 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.297660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947ac6a-442d-4442-bb61-68934d3ca572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.309437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.310949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.323029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5947ac6a-442d-4442-bb61-68934d3ca572 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:37.324303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5947ac6a-442d-4442-bb61-68934d3ca572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.388343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb6d0-b32b-4917-9e8c-c6410dc06ea7 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.393163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.393816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.394094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.394409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] PATH_INFO: `/v3/users/781ba571ce934078a5af2c1881a5753b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.395591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=781ba571ce934078a5af2c1881a5753b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.397528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.403086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1297/2596] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:37.413052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.413423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.413597 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.436169 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:37.437401 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.445824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1298/2597] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:37.450624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.466570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45c075-d713-4664-a272-971dd8cbf487 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.473006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.474091 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.475637 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.476414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.477609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781ba571ce934078a5af2c1881a5753b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.478334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781ba571ce934078a5af2c1881a5753b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.478472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:37.478902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.482004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.487069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781ba571ce934078a5af2c1881a5753b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.501414 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781ba571ce934078a5af2c1881a5753b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.505624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1299/2598] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:15:37.505785 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-574db010-87c7-4b7e-a091-a0268d43c5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781ba571ce934078a5af2c1881a5753b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:37.506835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:37.506988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.508975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.522650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1300/2599] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:37 2022] DELETE /identity/v3/users/781ba571ce934078a5af2c1881a5753b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:37.523593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b67bb-3f8a-4b52-840c-e885d9abc840 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.527770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.528057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.528330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.533168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:37.548750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:37.550011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.589940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.590851 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.591134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.591410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.592044 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.593945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.624942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1300/2600] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:37.625682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1301/2601] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:37.629467 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.639523 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.640577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:37.712359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c596-0798-493d-a193-52a1d5ea49b7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.721640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.722571 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.723034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.723454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f768-9b05-4ac4-a8a7-d2a5d52e421e None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.723584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.724456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.726752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.755211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1301/2602] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:37.766734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.779821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625df9-566a-4e25-a4ba-bb9dff49cf8d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.785843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.786582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.786943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.787539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.788175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.790567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.801532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1302/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:37.806033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.820818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.821959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.822664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.823274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.824736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80338-567f-4d6d-9b52-5f82a5b98e4d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.833864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.834947 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.835493 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.835982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.837591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.840185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.846988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.850880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c88a-6e12-4b43-ae4c-7037a2936cb2 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.854475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1303/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:37.859337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:37.867161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1302/2605] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:37.872062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab98f7-9611-43a1-8cf4-698fb19d9c5d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:37.877183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:37.877873 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.878154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.878465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] PATH_INFO: `/v3/projects/50d0c46fda094b68a2e7b7adc88e61e6/users/3cc082a87ab048e38c0bd59a2ce217d0/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.901397 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d0c46fda094b68a2e7b7adc88e61e6, user_id=3cc082a87ab048e38c0bd59a2ce217d0, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:37.904605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:37.923240 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1304/2606] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:37 2022] PUT /identity/v3/projects/50d0c46fda094b68a2e7b7adc88e61e6/users/3cc082a87ab048e38c0bd59a2ce217d0/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:37.933736 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:37.934018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:37.934314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:37.971945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] MFA Rules not processed for user `3cc082a87ab048e38c0bd59a2ce217d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:37.973180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.036598 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:38.065993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1303/2607] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:38.071394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.121549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:38.148343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcfbed-69a6-4bc6-894f-34a7b200a786 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.154118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.154776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.155057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.155330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.155985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.158277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.193039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1305/2608] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:38 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:38.194624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.212103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1fe3d-bc6c-4559-9141-cef41e3fd097 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.222818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.225220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.292647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.293174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.293454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.293726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.294399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.296328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.316388 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404109-30ad-46a7-bbf2-a1916d6131a4 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.319867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1304/2609] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:38 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:38.325294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.325976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.326662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.326954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.327254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] PATH_INFO: `/v3/projects/c99268d774ea4a1b9019b698d02646f1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.328415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99268d774ea4a1b9019b698d02646f1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.330425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.335673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814109cb-978f-4260-b398-44141a9fe493 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.341356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.342082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.342548 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.342826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.343479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.345128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.356942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1305/2610] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:38.362176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.374424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75b7b7-c814-40c1-9b51-ecef62262285 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.380492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.381167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.382154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.382540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] PATH_INFO: `/v3/projects/4d9edae6b12c4d359948d50faf700b2c/users/ba11d4add9504ea2a4d249ea0b0ce108/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.395159 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99268d774ea4a1b9019b698d02646f1', 'request_id': 'req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.404286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9edae6b12c4d359948d50faf700b2c, user_id=ba11d4add9504ea2a4d249ea0b0ce108, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.404906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99268d774ea4a1b9019b698d02646f1', 'request_id': 'req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.408734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.415279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99268d774ea4a1b9019b698d02646f1', 'request_id': 'req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.436185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1306/2611] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:38 2022] PUT /identity/v3/projects/4d9edae6b12c4d359948d50faf700b2c/users/ba11d4add9504ea2a4d249ea0b0ce108/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:38.437455 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] The token cache is being invalidate because project c99268d774ea4a1b9019b698d02646f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:38.437757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.439195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.440672 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.442122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1306/2612] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:38 2022] DELETE /identity/v3/projects/c99268d774ea4a1b9019b698d02646f1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:38.447499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.448700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.449137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.540515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:38.550337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0c6a0-f10c-4671-b8f2-d7b9f6eab8c3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.562125 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.563046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.563509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.563933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] PATH_INFO: `/v3/users/3e95453643ff4b6993845aaf248c6152` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.565016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedc136-6141-464c-9646-dd68e47a881d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.565505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e95453643ff4b6993845aaf248c6152)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.567257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.575179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.576840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.577135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.577420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.578093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.579867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.593303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1307/2613] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:38.597588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.609039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a575-8580-4edc-a0d5-468fa394830b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.613863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.614565 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.614848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.615133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] PATH_INFO: `/v3/projects/4d9edae6b12c4d359948d50faf700b2c/users/ba11d4add9504ea2a4d249ea0b0ce108/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.617081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9edae6b12c4d359948d50faf700b2c, user_id=ba11d4add9504ea2a4d249ea0b0ce108, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.620393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea4656-ec51-4618-a33e-805cc7a525c9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.621906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e95453643ff4b6993845aaf248c6152'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.622610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e95453643ff4b6993845aaf248c6152'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.629862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e95453643ff4b6993845aaf248c6152'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.631791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1308/2614] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:38 2022] PUT /identity/v3/projects/4d9edae6b12c4d359948d50faf700b2c/users/ba11d4add9504ea2a4d249ea0b0ce108/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:38.642229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.642557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.642837 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.646197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e95453643ff4b6993845aaf248c6152'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.646953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e95453643ff4b6993845aaf248c6152'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:38.662229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1307/2615] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:38 2022] DELETE /identity/v3/users/3e95453643ff4b6993845aaf248c6152 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:38.675486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] MFA Rules not processed for user `ba11d4add9504ea2a4d249ea0b0ce108`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:38.676943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.690933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:38.771082 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1309/2616] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:38.786333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:38.787934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:38.858868 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c25d-b254-49e6-811e-9a15c5836dcb admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:38.863036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:38.863661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:38.863943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:38.864218 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:38.874928 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:38.876385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:38.887222 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1308/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:39.058501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.060345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.118635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.120234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.210181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871a7f-d7bd-4bb5-8ad1-24d71192b5ba None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.225742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.229058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.229058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.229471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] PATH_INFO: `/v3/users/49d67a8645de4113ba0bd3ba88ab3fab` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.232434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d67a8645de4113ba0bd3ba88ab3fab)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.235823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.236067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512295-0111-460a-8486-c0377b35bba0 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.245484 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.246497 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.247182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.247182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] PATH_INFO: `/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.249650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7468dc5eba4640d2b9b94ad3db41fb66)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.252021 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.285303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:39.320430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d67a8645de4113ba0bd3ba88ab3fab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.321488 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d67a8645de4113ba0bd3ba88ab3fab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.332102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7468dc5eba4640d2b9b94ad3db41fb66', 'request_id': 'req-925baa3c-00d9-44d9-8ab8-e71477802611'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.342712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d67a8645de4113ba0bd3ba88ab3fab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.348069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7468dc5eba4640d2b9b94ad3db41fb66', 'request_id': 'req-925baa3c-00d9-44d9-8ab8-e71477802611'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.358600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7468dc5eba4640d2b9b94ad3db41fb66', 'request_id': 'req-925baa3c-00d9-44d9-8ab8-e71477802611'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.370532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d67a8645de4113ba0bd3ba88ab3fab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.371415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d67a8645de4113ba0bd3ba88ab3fab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.380667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] The token cache is being invalidate because project 7468dc5eba4640d2b9b94ad3db41fb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:39.380977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.381680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-925baa3c-00d9-44d9-8ab8-e71477802611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:39.384105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1309/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:39 2022] DELETE /identity/v3/projects/7468dc5eba4640d2b9b94ad3db41fb66 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:39.395976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d85e-03ce-40c3-bae7-17f2dbe940e4 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.396547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d85e-03ce-40c3-bae7-17f2dbe940e4 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.396974 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d85e-03ce-40c3-bae7-17f2dbe940e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.404527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1310/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:39 2022] DELETE /identity/v3/users/49d67a8645de4113ba0bd3ba88ab3fab => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:39.405594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.407163 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.421175 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2747d85e-03ce-40c3-bae7-17f2dbe940e4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:39.422798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2747d85e-03ce-40c3-bae7-17f2dbe940e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.452362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:39.510624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd0949-e9b5-40d3-9210-866c89787fd8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.517265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba11d4add9504ea2a4d249ea0b0ce108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9edae6b12c4d359948d50faf700b2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.518070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.518489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.518870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.519690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:39.520094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.527905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77793-85b2-4bbb-b3cc-6c54028d19f3 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.533170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1310/2620] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:39.534650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.535071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.535451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.559617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1311/2621] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:39.559617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.559617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.559617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.570515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:39.574967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.582468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:39.583925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.592028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1311/2622] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:39.593546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.598052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.602459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1312/2623] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:39.603749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.613860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31969e6b-477d-4ce2-8a57-9247de6db0ff None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.614445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19055baf-ec34-4760-a3d2-4d13c1c35e15 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.619298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.619605 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba11d4add9504ea2a4d249ea0b0ce108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9edae6b12c4d359948d50faf700b2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.620374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.620692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.620830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.620994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.621106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.621273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.621743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:39.621916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.622055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.623871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.624300 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.637899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1313/2624] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:39.638977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.641741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:39.668158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1312/2625] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/projects => generated 354 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:39.669416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.729405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d92b6-505a-42e9-b8ea-4f7492e351ea admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.768363 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6e856-b7fe-42fa-91bc-59ec29c42c46 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.773292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.773980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.774290 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.774575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.775216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.777163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.806446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1313/2626] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:39.807329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.810579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.811363 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.811838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.812113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.813983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:39.823115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.824580 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.840019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1314/2627] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:39.841692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.860104 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f3d2-f295-4029-a774-6495ac8c3d01 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.895236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04059c2-bf5c-48cb-b563-6c30b9e20f7b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:39.901316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba11d4add9504ea2a4d249ea0b0ce108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9edae6b12c4d359948d50faf700b2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.901942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.902279 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.902550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.903209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:39.903520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.905164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.920023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1314/2628] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:39.964924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:39.966012 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:39.966389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:39.966931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:39.967637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:39.969936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:39.978856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:39.980694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:39.995485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b957-fb15-49a0-9ffa-18912eceb4fb tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.002415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba11d4add9504ea2a4d249ea0b0ce108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9edae6b12c4d359948d50faf700b2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.003335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.003824 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.004483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] PATH_INFO: `/v3/projects/07531a07d5bb4e11b576cf239c89763e` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.005844 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=07531a07d5bb4e11b576cf239c89763e)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.008948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.018895 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1315/2629] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:39 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:40.021506 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.043834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7fce-8a4a-465e-9277-7654e445a9f1 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.059458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.060445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.060876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.061426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.062119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.063841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.076286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1316/2630] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:40.083423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.107479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07531a07d5bb4e11b576cf239c89763e', 'request_id': 'req-200f736e-fb70-46ba-b414-db2cdbf1dcb1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.112422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c909-8ec8-4b39-8a93-7edd4c28ada2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.118420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07531a07d5bb4e11b576cf239c89763e', 'request_id': 'req-200f736e-fb70-46ba-b414-db2cdbf1dcb1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.131478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07531a07d5bb4e11b576cf239c89763e', 'request_id': 'req-200f736e-fb70-46ba-b414-db2cdbf1dcb1'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.153958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] The token cache is being invalidate because project 07531a07d5bb4e11b576cf239c89763e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:40.154952 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.158292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.163315 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1315/2631] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:39 2022] DELETE /identity/v3/projects/07531a07d5bb4e11b576cf239c89763e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:40.201556 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.202616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.203078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.203504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.204325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.206359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.222445 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1317/2632] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:40.225201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.229013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.259292 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f736e-fb70-46ba-b414-db2cdbf1dcb1 tempest-VolumeQuotaClassesTest-85190224 tempest-VolumeQuotaClassesTest-85190224-project-admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.266475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.267158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.267570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.267860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] PATH_INFO: `/v3/projects/1a89f217f6c94117a95643e7f6b3d23f/users/a389be3e9fc249979aac8e8dece934bc/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.302108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a89f217f6c94117a95643e7f6b3d23f, user_id=a389be3e9fc249979aac8e8dece934bc, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.303386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.305956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a17df-a02e-46a3-a078-e4db98c323f3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.306558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.322123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec92c7-bf75-4f5d-ba3b-12b705d39289 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.335045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1316/2633] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:40 2022] PUT /identity/v3/projects/1a89f217f6c94117a95643e7f6b3d23f/users/a389be3e9fc249979aac8e8dece934bc/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:40.356521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.356754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.357283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.398736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] MFA Rules not processed for user `a389be3e9fc249979aac8e8dece934bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:40.400033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.418832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.420218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.420722 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.422389 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] PATH_INFO: `/v3/projects/b1f69673ae354f959653209f55c58013` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.424274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f69673ae354f959653209f55c58013)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.427854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.464317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:40.498311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1317/2634] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:40.498311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.498311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.507627 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f69673ae354f959653209f55c58013', 'request_id': 'req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.512190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe7c76-6535-4cc1-a9ac-b2da4ac50904 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.514419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f69673ae354f959653209f55c58013', 'request_id': 'req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.524762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f69673ae354f959653209f55c58013', 'request_id': 'req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.539141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] The token cache is being invalidate because project b1f69673ae354f959653209f55c58013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:40.540182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.541061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.542809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1318/2635] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:40 2022] DELETE /identity/v3/projects/b1f69673ae354f959653209f55c58013 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:40.547172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.548685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.555738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:40.577138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.577816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.578129 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.578445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] PATH_INFO: `/v3/users/3cc082a87ab048e38c0bd59a2ce217d0` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.579913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc082a87ab048e38c0bd59a2ce217d0)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.581865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.632096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee01a-e09e-4bc0-98b2-6c2f0b0daf8d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.636924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.637650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.638046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.638477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.640584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.646001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc082a87ab048e38c0bd59a2ce217d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.647057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc082a87ab048e38c0bd59a2ce217d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.659001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc082a87ab048e38c0bd59a2ce217d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.674155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc082a87ab048e38c0bd59a2ce217d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.674969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-0d3bdfe8-7837-44cb-a418-2a4ca6b40792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc082a87ab048e38c0bd59a2ce217d0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:40.689743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1318/2636] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:40 2022] DELETE /identity/v3/users/3cc082a87ab048e38c0bd59a2ce217d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:40.691072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f96c-6dde-481c-b63a-a624c646889c None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.691347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f96c-6dde-481c-b63a-a624c646889c None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.691635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0f96c-6dde-481c-b63a-a624c646889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.712785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4cb0f96c-6dde-481c-b63a-a624c646889c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:40.714166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4cb0f96c-6dde-481c-b63a-a624c646889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.723609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.725099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629fc29-e874-4adc-a723-e183227aa652 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.743835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1319/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:40.746469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.747195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.747536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.776626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:40.777956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.818464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1319/2638] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:40.827764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.828056 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.828335 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.846966 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:40.861308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:40.863433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.874356 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1320/2639] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:40.876440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1320/2640] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:40.877504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.888642 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.890529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:40.891381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076ac2-8055-42d7-a35a-7bd252731d87 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.896750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.897452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.897791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.898149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.899692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:40.900052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.901797 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:40.921262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1321/2641] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:15:40.928778 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:40.946691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aed-f3b7-4fab-8e7b-1da7e048f5ab admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:40.953595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:40.954953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:40.955374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:40.955817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:40.956809 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:40.959359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.001881 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1322/2642] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:40 2022] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:41.002641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892987-1e94-4736-807f-a95ca7c25dc5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.007535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.024967 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:41.073264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.073987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.074434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.074804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.125271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144552-416d-4cf2-8877-872f932d4233 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.134940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.135756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.136086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.136489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.137155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.139284 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.169524 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.170707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1323/2643] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:41 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:41.171514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.174922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.184767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1321/2644] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:41.214280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3717b-82a1-49af-be9e-9b371bb03bbe admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.216727 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.217333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.217610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.217903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.218897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.220505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.236982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1324/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:41.239036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.255626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a5d9-1a1c-4f12-9319-26233628ccaa service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.265735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.266357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.266622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.266900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.268036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.269219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa83d6d-e151-4b64-8042-ec2e97c750a6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.291498 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1322/2646] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:41.297932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.317856 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647ed43-f89b-45e2-a303-c2ce1736a82b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.328289 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.328994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.329327 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.329601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] PATH_INFO: `/v3/projects/05ae389ed0754b3da39dba7fb00203c2/users/6e0cbf22ed414382be08e13e25c6a07e/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.391208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae389ed0754b3da39dba7fb00203c2, user_id=6e0cbf22ed414382be08e13e25c6a07e, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.393902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.443641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1325/2647] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:41 2022] PUT /identity/v3/projects/05ae389ed0754b3da39dba7fb00203c2/users/6e0cbf22ed414382be08e13e25c6a07e/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:41.454309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.454890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.455175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.493257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] MFA Rules not processed for user `6e0cbf22ed414382be08e13e25c6a07e`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:41.495096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:41.579052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1323/2648] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:41.583765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.660274 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.661824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:41.679126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e25453-22fa-4325-8311-649b66f0f1ba admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.691915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.693547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.693937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.694405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.714071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.718805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.751416 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1326/2649] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:41 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:41.756202 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.763361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:41.767863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:41.791475 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb86d6-948f-4929-9e01-ba87b4acf5a0 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.871550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce82f9-d2dd-4552-8828-ca549781196d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.872181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.872836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.873119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.873397 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] PATH_INFO: `/v3/projects/50d0c46fda094b68a2e7b7adc88e61e6` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.874613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d0c46fda094b68a2e7b7adc88e61e6)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.876540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.876729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.877338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.877613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.877883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.878544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.880451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:41.909269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1327/2650] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:41 2022] POST /identity/v3/users => generated 308 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:41.911988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.923232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f51c-c29b-4529-a7e4-f49689c77f74 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:41.928326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d0c46fda094b68a2e7b7adc88e61e6', 'request_id': 'req-fc575201-5066-49c6-8ecd-d16469c16914'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:41.935956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d0c46fda094b68a2e7b7adc88e61e6', 'request_id': 'req-fc575201-5066-49c6-8ecd-d16469c16914'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:41.945025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d0c46fda094b68a2e7b7adc88e61e6', 'request_id': 'req-fc575201-5066-49c6-8ecd-d16469c16914'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:41.956448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] The token cache is being invalidate because project 50d0c46fda094b68a2e7b7adc88e61e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:41.956769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:41.957723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:41.959251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1324/2651] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:41 2022] DELETE /identity/v3/projects/50d0c46fda094b68a2e7b7adc88e61e6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:41.963936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:41.965372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:41.993694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:41.994372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:41.994795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:41.994929 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:41.995584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:41.997225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.008312 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1328/2652] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:42.012725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.014513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.030630 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdc90-0d11-4c6d-aa23-01f086ca9918 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.036993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.037705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.038103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.038568 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] PATH_INFO: `/v3/projects/357daaa078c4474fa5edfd20b3bcaf77/users/8f35d80a18674f3ba71a934c7673a9eb/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.050544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575201-5066-49c6-8ecd-d16469c16914 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.055068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] RBAC: Authorizing `identity:create_grant(project_id=357daaa078c4474fa5edfd20b3bcaf77, user_id=8f35d80a18674f3ba71a934c7673a9eb, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.055513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.056149 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.056428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.056698 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] PATH_INFO: `/v3/users/ba11d4add9504ea2a4d249ea0b0ce108` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.057855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba11d4add9504ea2a4d249ea0b0ce108)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.057988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.059807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.072247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1329/2653] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:42 2022] PUT /identity/v3/projects/357daaa078c4474fa5edfd20b3bcaf77/users/8f35d80a18674f3ba71a934c7673a9eb/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:42.076243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.087255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:42.115795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba11d4add9504ea2a4d249ea0b0ce108'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.116555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba11d4add9504ea2a4d249ea0b0ce108'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.124430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba11d4add9504ea2a4d249ea0b0ce108'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.139959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba11d4add9504ea2a4d249ea0b0ce108'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.140945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba11d4add9504ea2a4d249ea0b0ce108'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.142429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bedc4-b7bc-4aa2-9972-3cfe10da369c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.148071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.149244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.149529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.149789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.150505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.152109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6fd88-c651-4c53-b410-fdf532668a5b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.159255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1325/2654] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:41 2022] DELETE /identity/v3/users/ba11d4add9504ea2a4d249ea0b0ce108 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:42.166581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1330/2655] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:42.168306 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.170333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.256018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed229a-61a5-4dd6-a375-45959f11d43f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.264059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.264886 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.265281 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.265688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] PATH_INFO: `/v3/projects/357daaa078c4474fa5edfd20b3bcaf77/users/8f35d80a18674f3ba71a934c7673a9eb/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.269646 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357daaa078c4474fa5edfd20b3bcaf77, user_id=8f35d80a18674f3ba71a934c7673a9eb, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.277079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.297875 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1326/2656] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:42 2022] PUT /identity/v3/projects/357daaa078c4474fa5edfd20b3bcaf77/users/8f35d80a18674f3ba71a934c7673a9eb/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:42.315216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.315503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.315777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.323990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:42.355261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] MFA Rules not processed for user `8f35d80a18674f3ba71a934c7673a9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:42.356996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.443837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1331/2657] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:42.455346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.457183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.501937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.504770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.562518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5428b-394e-4d47-bac6-b251cfc82809 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.567275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.567934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.568303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.568586 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.580337 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.581848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbfc7-8cf7-49c6-8ab1-95060095dd9a service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.593686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1327/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:42 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:42.607883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675087f-dbba-45ff-a1ca-a7f97bfb9f56 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.613910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.614863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.615346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.615943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] PATH_INFO: `/v3/projects/4d9edae6b12c4d359948d50faf700b2c` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.617671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9edae6b12c4d359948d50faf700b2c)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.620106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.701961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9edae6b12c4d359948d50faf700b2c', 'request_id': 'req-ec4bc824-90d9-489c-ac26-8569b8960341'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.725048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9edae6b12c4d359948d50faf700b2c', 'request_id': 'req-ec4bc824-90d9-489c-ac26-8569b8960341'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.738186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9edae6b12c4d359948d50faf700b2c', 'request_id': 'req-ec4bc824-90d9-489c-ac26-8569b8960341'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.768844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.769892 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.770360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.772350 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] The token cache is being invalidate because project 4d9edae6b12c4d359948d50faf700b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:42.772755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.773826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-ec4bc824-90d9-489c-ac26-8569b8960341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:42.776546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1332/2659] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:42 2022] DELETE /identity/v3/projects/4d9edae6b12c4d359948d50faf700b2c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:42.783872 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18447d-fc76-455e-95d2-f5c425ba84fc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.784671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18447d-fc76-455e-95d2-f5c425ba84fc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.785519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18447d-fc76-455e-95d2-f5c425ba84fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.809072 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:42.810611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.815987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ab18447d-fc76-455e-95d2-f5c425ba84fc None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:42.817820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ab18447d-fc76-455e-95d2-f5c425ba84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.835399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:42.863499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:42.892119 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1328/2660] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:42.893092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.894520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.919820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1333/2661] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:42.919820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.919820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.921378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.945301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:42.947017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:42.960323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1334/2662] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:42.966980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:42.977814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3b45-fcdb-484c-826c-b63b15002680 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.983107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:42.983726 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:42.984009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:42.984282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:42.984936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:42.985242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:42.986960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:42.994815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518d96-c10e-4827-a1fa-d16ab7eef680 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:42.999936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.000302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1335/2663] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:43.001164 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.002953 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.003864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.004257 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.004763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] PATH_INFO: `/v3/users/6e0cbf22ed414382be08e13e25c6a07e` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.007242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0cbf22ed414382be08e13e25c6a07e)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.011663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.091758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0cbf22ed414382be08e13e25c6a07e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:43.093285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0cbf22ed414382be08e13e25c6a07e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:43.100272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e4d7-90c5-47fa-a55c-e73b9f52265d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.113777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.114449 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.114735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.115007 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.115115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0cbf22ed414382be08e13e25c6a07e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:43.116956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.129641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.131344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.138179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0cbf22ed414382be08e13e25c6a07e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:43.139198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-f9985c37-182e-43d8-a96b-9e0ba07ce3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0cbf22ed414382be08e13e25c6a07e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:43.142979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1336/2664] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:15:43.143895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.145383 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.163990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6872-31ab-43d6-babe-58d348804961 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.167568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1329/2665] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:42 2022] DELETE /identity/v3/users/6e0cbf22ed414382be08e13e25c6a07e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:43.173325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.173941 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.174228 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.174457 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.174576 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.174774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.175054 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.175458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.177525 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.199959 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:43.201726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.216993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1337/2666] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:43.221550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.297784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1330/2667] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:43.311739 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.314461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.319541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387513-aedc-4741-9a27-58b0874fcc9f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.321180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:43.327361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.328246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.328246 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.328539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.329200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.331274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.353223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:43.378443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1338/2668] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:43.380004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.393711 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f0e9-d573-4ce9-85c1-a3ecae9170c1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.402155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.402938 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.403338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.403700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.404454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.406454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.419525 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bced-2b6a-4280-aba7-8729b7b7f35f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.424622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1339/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:43.434415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.454959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e87640-ad8e-451c-804e-e66fb319c637 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.460997 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.462507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.462795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.463112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.463854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.466012 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.488653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1340/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:43.490429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.498275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.498930 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.499469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.499752 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.513908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da4dc-4dfe-41cf-b438-5aad9c8317ac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.522002 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.522909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.523248 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.523869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] PATH_INFO: `/v3/projects/f12903d19ae6461f92d3a87233ac61c1/users/c80332854e8f45f58de81e7e4cb15cda/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.530611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.532195 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7027e-bab6-4fe1-ad9a-47dcbc3b6988 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.548909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12903d19ae6461f92d3a87233ac61c1, user_id=c80332854e8f45f58de81e7e4cb15cda, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.552765 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.555531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1331/2671] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:43.584411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1341/2672] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:43 2022] PUT /identity/v3/projects/f12903d19ae6461f92d3a87233ac61c1/users/c80332854e8f45f58de81e7e4cb15cda/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:43.588728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.588728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.589173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.642907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] MFA Rules not processed for user `c80332854e8f45f58de81e7e4cb15cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:43.644659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:43.796161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.799171 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1332/2673] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:43.897861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee7347-ee05-44de-b267-e43e15f9b1c7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:43.908081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:43.909038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:43.909321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:43.909608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:43.910308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:43.912751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:43.949820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1342/2674] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:43.954345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:43.978079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea5cb-5990-4d7c-8ff3-d31b60e12b9b None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.084461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.087938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:44.089670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:44.113366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.118741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.119027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.119496 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.120277 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.122616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.166516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1333/2675] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:43 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:44.171572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.185147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da96cc2-cb7c-415b-8cd5-c92267577a70 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.196297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.196935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.197205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.197485 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.198294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.202391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.221565 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5a7a-004d-4736-8fcb-ae748796addd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.231147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1334/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:44.232710 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.233296 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.233585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.233863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] PATH_INFO: `/v3/projects/05ae389ed0754b3da39dba7fb00203c2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.235654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ae389ed0754b3da39dba7fb00203c2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.240927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.241154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.257867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2e636-410e-44d4-a51f-8797701da35f admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.264126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.265179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.265487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.265744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] PATH_INFO: `/v3/projects/f84a7dfae4844705a7591de092846132/users/90686ab799f84e0bb7d061e74f3ef98b/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.287034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84a7dfae4844705a7591de092846132, user_id=90686ab799f84e0bb7d061e74f3ef98b, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.289690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.302017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:44.310299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1335/2677] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:44 2022] PUT /identity/v3/projects/f84a7dfae4844705a7591de092846132/users/90686ab799f84e0bb7d061e74f3ef98b/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:44.314702 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.317631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ae389ed0754b3da39dba7fb00203c2', 'request_id': 'req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.328783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ae389ed0754b3da39dba7fb00203c2', 'request_id': 'req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.339451 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ae389ed0754b3da39dba7fb00203c2', 'request_id': 'req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.356849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] The token cache is being invalidate because project 05ae389ed0754b3da39dba7fb00203c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:44.357231 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.358807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.361417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:44 2022] DELETE /identity/v3/projects/05ae389ed0754b3da39dba7fb00203c2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:44.366377 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.368995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:44.428616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeb961-afc5-434a-9d16-b6f795731d8c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.435412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.436310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.436701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.437350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.437900 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.439926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.453994 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1336/2679] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:44.459159 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.461724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:44.472078 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d0ca-a666-47c8-b5bf-c21ac79cf8ac admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.476141 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f753-9718-4e7b-ae1f-d58190f6db9a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.478163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.478796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.479100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.479887 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] PATH_INFO: `/v3/users/8f35d80a18674f3ba71a934c7673a9eb` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.481096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f35d80a18674f3ba71a934c7673a9eb)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.483183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.487193 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.488310 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.488809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.489307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] PATH_INFO: `/v3/projects/f84a7dfae4844705a7591de092846132/users/90686ab799f84e0bb7d061e74f3ef98b/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.491588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84a7dfae4844705a7591de092846132, user_id=90686ab799f84e0bb7d061e74f3ef98b, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.494758 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b510ed7-c9e1-483a-bf02-d660dc7760e9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.506879 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1337/2680] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:44 2022] PUT /identity/v3/projects/f84a7dfae4844705a7591de092846132/users/90686ab799f84e0bb7d061e74f3ef98b/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:44.519143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.519815 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.520315 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.548197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f35d80a18674f3ba71a934c7673a9eb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.549216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f35d80a18674f3ba71a934c7673a9eb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.561046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] MFA Rules not processed for user `90686ab799f84e0bb7d061e74f3ef98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:44.563108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:44.571653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f35d80a18674f3ba71a934c7673a9eb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.593950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f35d80a18674f3ba71a934c7673a9eb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.595080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f35d80a18674f3ba71a934c7673a9eb'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:44.613805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1344/2681] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:44 2022] DELETE /identity/v3/users/8f35d80a18674f3ba71a934c7673a9eb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:44.670405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1338/2682] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:44.684367 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:44.686235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:44.777920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:44.802908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46a46-62b1-4244-b627-91064c018785 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:44.810890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:44.811761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:44.811882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:44.812756 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:44.960080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:44.962975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:44.977654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1345/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:45.050016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.052620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:45.092792 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:45.096523 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.099718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:45.123779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c19a-a20b-4aa2-89b7-e7b1d84ac269 service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.128722 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.129472 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.129973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.130516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.132745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:45.203891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa8e0-d9b9-486d-9228-27f1eb82f7d6 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.237815 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.240298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3dabb-c856-4fdf-ba08-106a7c016d9c service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.255452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1346/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:45.289818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.290514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.291063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.291063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] PATH_INFO: `/v3/projects/357daaa078c4474fa5edfd20b3bcaf77` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.292280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=357daaa078c4474fa5edfd20b3bcaf77)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.294367 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.367715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357daaa078c4474fa5edfd20b3bcaf77', 'request_id': 'req-5941b8c1-0cc1-41a8-8609-00158f05f65e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:45.377395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357daaa078c4474fa5edfd20b3bcaf77', 'request_id': 'req-5941b8c1-0cc1-41a8-8609-00158f05f65e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:45.388321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357daaa078c4474fa5edfd20b3bcaf77', 'request_id': 'req-5941b8c1-0cc1-41a8-8609-00158f05f65e'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:45.401476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] The token cache is being invalidate because project 357daaa078c4474fa5edfd20b3bcaf77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:45.402034 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:45.403057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-5941b8c1-0cc1-41a8-8609-00158f05f65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:45.405100 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1339/2685] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:45 2022] DELETE /identity/v3/projects/357daaa078c4474fa5edfd20b3bcaf77 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:45.411359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.412020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.412443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.442931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:45.445935 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:45.542355 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:45.551804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.552325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.552602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.587229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:45.589058 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:45.609374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1340/2687] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:45.610435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.622624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a355e-5896-43d3-9fba-7c9ad6c918bc None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.640770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.641489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.641840 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.642422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.643037 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:45.643657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.645769 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.666628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1348/2688] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:45.667784 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.698270 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbbb20-82e0-4d1c-9ff2-ee3a5c9ec6f5 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.716223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.716977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.717336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.721810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.723732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.725128 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.783099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1341/2689] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:45 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:45.788942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.818104 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5caa7-75fe-4772-97e9-7e7bccfc46fa admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.846910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:45.896420 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.897260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.897574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.897818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.898994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.901360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.924268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1349/2690] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:45 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:45.928497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.939370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7eb7-88a0-42f8-bd01-1be709e29bd8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.944259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.944881 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.945223 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.945426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.946066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.947701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.957668 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1342/2691] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:45.962160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:45.972517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913997-8f3a-49d9-9482-cf5655e0db31 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:45.977913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:45.978783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:45.979069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:45.979344 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:45.979993 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:45.981596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013041-4776-4242-b059-18251dfd68ff admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:45.992450 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1350/2692] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:45.996791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.006695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261913-dc3a-4ddf-b5c8-219e135ffb86 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.012269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.013078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.013359 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.013772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] PATH_INFO: `/v3/projects/d93c1350889a473abdbba044261ec825/users/9216c99e22d34f80a3201788e2a54595/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.022073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:46.031298 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93c1350889a473abdbba044261ec825, user_id=9216c99e22d34f80a3201788e2a54595, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.034220 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.047323 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1343/2693] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:45 2022] PUT /identity/v3/projects/d93c1350889a473abdbba044261ec825/users/9216c99e22d34f80a3201788e2a54595/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:46.057575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.057861 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.058134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.087478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] MFA Rules not processed for user `9216c99e22d34f80a3201788e2a54595`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:46.088746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:46.169303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1351/2694] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:46.173862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.265353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c08f6-d25e-44b7-ad0f-af9440be23a9 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.285709 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.286678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.287748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.288063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.289942 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.293662 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.323899 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1344/2695] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:46 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:46.327945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.339609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c7240-aad4-478b-8110-f1c8994e04a7 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.399146 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.400095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.400654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.401405 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.402123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.404095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.434498 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1352/2696] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:46 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:46.435424 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.449063 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a41c1-e598-48d1-a8aa-dd4b0aa730ad admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.455756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.456447 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.456921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.457423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.457936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.459616 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.478182 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1345/2697] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:46.482432 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.494167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c9fc-c2eb-4268-b878-0c7136f05ce7 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.499454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.500142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.500426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.500709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] PATH_INFO: `/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b/users/a9303ad9f3a34fb882e52a8c58fb2734/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.523055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=febff5a3dfae4ce38e55d58e34b8e34b, user_id=a9303ad9f3a34fb882e52a8c58fb2734, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.526316 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.528705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:46.542200 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1353/2698] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:46 2022] PUT /identity/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b/users/a9303ad9f3a34fb882e52a8c58fb2734/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:46.546153 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.557419 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47f83-4dbc-41ce-94ae-a871fff89f1a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.638333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.639055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.639352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.639613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.640253 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.641885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec96a0-852a-49ba-b088-a6bc6dd3ae10 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.657130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.657873 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1346/2699] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:46.673738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d27f7-f70e-42ff-ad90-8eae4b6bf98e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.680933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.681606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.681883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.682155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] PATH_INFO: `/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b/users/a9303ad9f3a34fb882e52a8c58fb2734/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.684195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febff5a3dfae4ce38e55d58e34b8e34b, user_id=a9303ad9f3a34fb882e52a8c58fb2734, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.687017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:46.700431 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1354/2700] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:46 2022] PUT /identity/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b/users/a9303ad9f3a34fb882e52a8c58fb2734/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:46.711664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.711960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.712243 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.747316 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] MFA Rules not processed for user `a9303ad9f3a34fb882e52a8c58fb2734`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:46.748713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:46.801670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:46.842725 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1347/2701] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:46.856986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:46.859063 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:46.954199 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d416-314a-44ea-828b-7b3d5a5af8f3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:46.960474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:46.961703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:46.962404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:46.963866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:46.984163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:46.986681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5fefe-17c3-4bdb-98b3-379787b2058a service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:47.003669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1355/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:47.943686 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:48.065184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653df4e-cd9c-4d85-849f-b3caaca13f04 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:48.072643 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:48.073348 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:48.073681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:48.073944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] PATH_INFO: `/v3/users/9216c99e22d34f80a3201788e2a54595` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:48.075187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9216c99e22d34f80a3201788e2a54595)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:48.077931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:48.157969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9216c99e22d34f80a3201788e2a54595'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:48.160266 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9216c99e22d34f80a3201788e2a54595'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:48.170576 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9216c99e22d34f80a3201788e2a54595'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:48.191269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9216c99e22d34f80a3201788e2a54595'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:48.192562 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9216c99e22d34f80a3201788e2a54595'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:48.223765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1348/2703] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:47 2022] DELETE /identity/v3/users/9216c99e22d34f80a3201788e2a54595 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:48.229364 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:48.229904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:48.230001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:48.250422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:48.252103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:48.339625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1356/2704] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:48.349913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:48.351451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:48.418622 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a527de-88ba-4079-aad8-978ec5dea34b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:48.422928 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:48.423557 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:48.423840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:48.424189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:48.434364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:48.435791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:48.446309 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1349/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:48.774552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:48.777074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:48.798304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b1e0-ea69-42a3-ac3c-166147dc0bb8 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:48.815985 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:48.816713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:48.817026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:48.817329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] PATH_INFO: `/v3/projects/d93c1350889a473abdbba044261ec825` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:48.818644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93c1350889a473abdbba044261ec825)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:48.821298 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:49.018627 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93c1350889a473abdbba044261ec825', 'request_id': 'req-280e0379-cfcf-4b62-aa59-cf23367aad4c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.031584 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93c1350889a473abdbba044261ec825', 'request_id': 'req-280e0379-cfcf-4b62-aa59-cf23367aad4c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.043039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93c1350889a473abdbba044261ec825', 'request_id': 'req-280e0379-cfcf-4b62-aa59-cf23367aad4c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.059649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] The token cache is being invalidate because project d93c1350889a473abdbba044261ec825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:49.059649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.060516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.062273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1357/2706] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:48 2022] DELETE /identity/v3/projects/d93c1350889a473abdbba044261ec825 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:49.066212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:49.074934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:49.080386 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af7593-90bb-4225-b501-1f7bf702a2ad service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:49.171802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:49.172577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:49.172929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:49.173268 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] PATH_INFO: `/v3/users/a9303ad9f3a34fb882e52a8c58fb2734` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:49.174515 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9303ad9f3a34fb882e52a8c58fb2734)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:49.176584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:49.253896 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9303ad9f3a34fb882e52a8c58fb2734'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.254675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9303ad9f3a34fb882e52a8c58fb2734'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.271217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9303ad9f3a34fb882e52a8c58fb2734'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.298891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9303ad9f3a34fb882e52a8c58fb2734'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.299660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9303ad9f3a34fb882e52a8c58fb2734'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.320025 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1350/2707] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:49 2022] DELETE /identity/v3/users/a9303ad9f3a34fb882e52a8c58fb2734 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:49.483950 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:49.486653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:49.505273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0379-cfcf-4b62-aa59-cf23367aad4c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:49.510960 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:49.635217 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:49.637437 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:49.638288 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:49.640036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] PATH_INFO: `/v3/users/c80332854e8f45f58de81e7e4cb15cda` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:49.642668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80332854e8f45f58de81e7e4cb15cda)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:49.646134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:49.734277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80332854e8f45f58de81e7e4cb15cda'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.735454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80332854e8f45f58de81e7e4cb15cda'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.751976 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80332854e8f45f58de81e7e4cb15cda'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.784226 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:49.787067 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:49.789707 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80332854e8f45f58de81e7e4cb15cda'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.791252 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-854cfce7-2d8c-4429-aa10-95ee8491a8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80332854e8f45f58de81e7e4cb15cda'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:49.813968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1358/2708] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:49 2022] DELETE /identity/v3/users/c80332854e8f45f58de81e7e4cb15cda => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:49.819533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:49.819961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:49.820492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:49.839546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b04f-c9f6-42d9-9214-e74b2166aa62 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:49.844713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:49.845944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:49.929507 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1359/2709] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:49.936505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:49.937329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:49.937715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:49.938091 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] PATH_INFO: `/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:49.939442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=febff5a3dfae4ce38e55d58e34b8e34b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:49.941648 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:49.951040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:49.952599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:49.989676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:50.001909 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:50.036134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dd994-0ea7-4b7f-b854-70eba8de9701 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.037938 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febff5a3dfae4ce38e55d58e34b8e34b', 'request_id': 'req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.045774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febff5a3dfae4ce38e55d58e34b8e34b', 'request_id': 'req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.058165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febff5a3dfae4ce38e55d58e34b8e34b', 'request_id': 'req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.096107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] The token cache is being invalidate because project febff5a3dfae4ce38e55d58e34b8e34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:50.096762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.098418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-0af47aaa-89b9-4aeb-85c7-fa8efa22aaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.100612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1351/2710] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:49 2022] DELETE /identity/v3/projects/febff5a3dfae4ce38e55d58e34b8e34b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:50.112821 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6557d-7046-4839-b831-cee28c714b66 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.113276 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6557d-7046-4839-b831-cee28c714b66 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.113740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6557d-7046-4839-b831-cee28c714b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.131241 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.132233 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.132669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.133753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.137035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.139271 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7ff6557d-7046-4839-b831-cee28c714b66 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:50.140678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7ff6557d-7046-4839-b831-cee28c714b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.233480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1352/2711] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:50.243677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.244008 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.244237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.267051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.268689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.269584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:50.270934 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.282534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1353/2712] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:50.286788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.287214 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1360/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:50.300499 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb3fb-1798-4dd6-a662-17ec0e1f0513 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.307432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.308196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.308577 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.308969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.309723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:50.310114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.311917 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.329411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1354/2714] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:15:50.330728 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.342575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0ec8b-f3a2-4fcd-a879-b6803173c4a7 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.347849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.348624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.349072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.349421 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.350207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.352602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.390098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1361/2715] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:50.394749 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.408704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b3482-3afa-470e-b3b2-408d1bf9c2fb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.512251 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.513131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.513131 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.513426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.514096 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.517083 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.551198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1355/2716] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:50.555147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.570579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6661a-0af2-44ac-9319-197fd5dd5470 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.577053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.577685 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.577986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.578311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.579067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.580876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.593821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1362/2717] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:50.598904 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.610587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d606b5-22a5-452d-922b-95c17c83369e admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.617623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.618340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.618634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.619015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.619764 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.621472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.641075 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1356/2718] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:50.646583 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.667770 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.671971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9f832-2533-47ff-a7c3-d7d92ce015fe admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.673454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.686636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.687345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.687648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.687926 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] PATH_INFO: `/v3/projects/0932d42a8f944065b4f06afefef3ded6/users/c2f6d025314d4b35a7b06acb64ec74a5/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.709870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0932d42a8f944065b4f06afefef3ded6, user_id=c2f6d025314d4b35a7b06acb64ec74a5, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.714198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145a5b-768e-48a1-8f02-336eb40d65c2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.715368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068c8b4-87ee-4459-b3e1-f53ab7750e60 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.721236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.722107 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.722588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.723026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] PATH_INFO: `/v3/projects/f12903d19ae6461f92d3a87233ac61c1` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.724755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12903d19ae6461f92d3a87233ac61c1)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.727029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:50.735721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1363/2719] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:50 2022] PUT /identity/v3/projects/0932d42a8f944065b4f06afefef3ded6/users/c2f6d025314d4b35a7b06acb64ec74a5/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:50.736949 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:50.748032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.748326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.748582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.786204 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] MFA Rules not processed for user `c2f6d025314d4b35a7b06acb64ec74a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:50.787480 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.805140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12903d19ae6461f92d3a87233ac61c1', 'request_id': 'req-aff8ea3f-e043-45d2-b27b-3246df5c0387'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.812578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12903d19ae6461f92d3a87233ac61c1', 'request_id': 'req-aff8ea3f-e043-45d2-b27b-3246df5c0387'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.816560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:50.823724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12903d19ae6461f92d3a87233ac61c1', 'request_id': 'req-aff8ea3f-e043-45d2-b27b-3246df5c0387'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.841294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] The token cache is being invalidate because project f12903d19ae6461f92d3a87233ac61c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:50.842118 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.843111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:50.845634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1357/2720] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:50 2022] DELETE /identity/v3/projects/f12903d19ae6461f92d3a87233ac61c1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:50.849625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.851114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.886408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1364/2721] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:50.889444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:50.891100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:50.944267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ea3f-e043-45d2-b27b-3246df5c0387 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:50.951838 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:50.952774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:50.953113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:50.953450 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] PATH_INFO: `/v3/users/90686ab799f84e0bb7d061e74f3ef98b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:50.955431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90686ab799f84e0bb7d061e74f3ef98b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:50.956905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.014345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1f257-152f-4b16-ba5f-09ea3f84d546 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.021054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.022103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.022543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.022878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.023977 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.026220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.051810 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90686ab799f84e0bb7d061e74f3ef98b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.052765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90686ab799f84e0bb7d061e74f3ef98b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.062020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1365/2722] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:50 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:51.062989 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.064510 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90686ab799f84e0bb7d061e74f3ef98b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.065270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:51.092993 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90686ab799f84e0bb7d061e74f3ef98b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.094733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90686ab799f84e0bb7d061e74f3ef98b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.116036 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1358/2723] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:50 2022] DELETE /identity/v3/users/90686ab799f84e0bb7d061e74f3ef98b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:51.169212 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace6cac-cb53-4645-b87f-574607c500dd admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.262860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:51.273006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.275046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.275719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.276116 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.277704 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.282694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.314059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1366/2724] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:51 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:51.320788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.338280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1f6f-d0cc-434a-a71f-7ebfd92d6410 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.346637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.348477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.348624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.349139 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.350591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.352133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.374644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.376564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1359/2725] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:51.387561 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d602-e24e-4250-8915-b392096e9b40 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.393209 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.394539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.395030 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.395587 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] PATH_INFO: `/v3/projects/5f1549528bc3445ab95eca3148fda5ff/users/938c326239774f2a9ca8d431f6594cc5/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.417326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1549528bc3445ab95eca3148fda5ff, user_id=938c326239774f2a9ca8d431f6594cc5, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.421089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.438628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1367/2726] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:51 2022] PUT /identity/v3/projects/5f1549528bc3445ab95eca3148fda5ff/users/938c326239774f2a9ca8d431f6594cc5/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:51.442400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.451860 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:51.459417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16fc8b-667e-4e45-8a4b-6b1313cc88ac admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.540852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.541889 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.542303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.542717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.543455 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.545568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916c09b-644a-452b-bb26-76d5564003b3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.557413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1360/2727] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:51.561463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.573368 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506863-4c7a-4134-a158-e95dddbab1a6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.580613 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.581554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.581918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.582362 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] PATH_INFO: `/v3/projects/5f1549528bc3445ab95eca3148fda5ff/users/938c326239774f2a9ca8d431f6594cc5/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.584800 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1549528bc3445ab95eca3148fda5ff, user_id=938c326239774f2a9ca8d431f6594cc5, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.588341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.609847 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1368/2728] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:51 2022] PUT /identity/v3/projects/5f1549528bc3445ab95eca3148fda5ff/users/938c326239774f2a9ca8d431f6594cc5/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:51.625210 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.625943 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.626311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.626936 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.636317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:51.668410 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] MFA Rules not processed for user `938c326239774f2a9ca8d431f6594cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:51.670234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:51.750167 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509d55-8450-4d85-bb96-c409743dc6d3 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.767197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:51.767870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.768309 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.768662 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] PATH_INFO: `/v3/projects/f84a7dfae4844705a7591de092846132` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.770026 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84a7dfae4844705a7591de092846132)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:51.773982 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:51.782196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1361/2729] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:51.799147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:51.803588 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:51.865917 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84a7dfae4844705a7591de092846132', 'request_id': 'req-787b8c5a-e671-4b61-92d4-44af0fe7163f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.878178 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84a7dfae4844705a7591de092846132', 'request_id': 'req-787b8c5a-e671-4b61-92d4-44af0fe7163f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.891866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84a7dfae4844705a7591de092846132', 'request_id': 'req-787b8c5a-e671-4b61-92d4-44af0fe7163f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.911301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] The token cache is being invalidate because project f84a7dfae4844705a7591de092846132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:51.911879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.913828 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-787b8c5a-e671-4b61-92d4-44af0fe7163f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:51.919745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1369/2730] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:51 2022] DELETE /identity/v3/projects/f84a7dfae4844705a7591de092846132 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:51.919978 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7630e4-215b-4501-a7b8-3b7e93041b8d None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:51.921821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba008fe-9e37-4255-a6a8-afe023497097 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:51.922369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba008fe-9e37-4255-a6a8-afe023497097 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:51.922843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba008fe-9e37-4255-a6a8-afe023497097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:51.948433 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bba008fe-9e37-4255-a6a8-afe023497097 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:51.950546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bba008fe-9e37-4255-a6a8-afe023497097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:51.997650 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:52.009962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:52.014184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.014863 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.015147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.015423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.017700 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:52.047408 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1370/2731] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:52.055855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.056229 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.056602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.091080 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:52.092655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:52.104058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1371/2732] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:15:52.109137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.123071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.124817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89687ff2-f271-4274-b3ab-b62b4a17d54a None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.125991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.130156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.131412 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.131653 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.132024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.132807 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:52.133211 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.135094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.143654 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1362/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:52.160134 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1372/2734] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:52.160507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.177638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec9c59-bf10-46d0-98aa-c7d0843fc27e service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.191095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.192111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.192469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.192753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.193526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.196098 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.245759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1363/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/projects => generated 399 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:52.247614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.276673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ba5b-52d9-4beb-8b3f-8bc9b608cd95 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.375274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.376378 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.376958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.377423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.378414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.380625 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.441152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1373/2736] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:52.459423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.472811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d421b9-e5d5-4638-b27b-c57f68e40c50 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.484767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.485437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.485742 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.486179 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.486968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.488835 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.513542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1364/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:52.514837 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.529276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8497b-b84d-48cc-bc7b-c2e432f96660 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.534153 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.534870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.535148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.535631 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.536381 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.538232 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c48756-3ff3-4dba-9ad0-c703a16571c0 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.553986 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1374/2738] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:52.555808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.567224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2954d1-50d7-44f3-a81a-afd386bf58f6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.587356 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.588114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.588400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.588694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] PATH_INFO: `/v3/projects/3697bf35f61f41e7b5d4bf197b645b6c/users/84013f0a92b84e23acc53d5cf9a881f0/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.606462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3697bf35f61f41e7b5d4bf197b645b6c, user_id=84013f0a92b84e23acc53d5cf9a881f0, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.609564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.638002 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1365/2739] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:52 2022] PUT /identity/v3/projects/3697bf35f61f41e7b5d4bf197b645b6c/users/84013f0a92b84e23acc53d5cf9a881f0/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:52.640593 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.641097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.641337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.684820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] MFA Rules not processed for user `84013f0a92b84e23acc53d5cf9a881f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:52.686384 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:52.751133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.753340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:52.794170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1375/2740] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:52.795601 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.841913 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab37f-f00a-4dd5-be92-7040d05210a2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.845317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:52.848146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.848874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.849238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.849926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] PATH_INFO: `/v3/users/c2f6d025314d4b35a7b06acb64ec74a5` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.851489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f6d025314d4b35a7b06acb64ec74a5)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.853950 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.898157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab30f-8f1e-4dbd-95e2-20caf14cb3ac None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:52.909802 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:52.910906 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:52.911773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.912245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.912697 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:52.913729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:52.917936 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:52.925290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f6d025314d4b35a7b06acb64ec74a5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:52.926267 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f6d025314d4b35a7b06acb64ec74a5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:52.934640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f6d025314d4b35a7b06acb64ec74a5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:52.951712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f6d025314d4b35a7b06acb64ec74a5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:52.952540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-4be2b16d-ce6a-4330-8426-119646f26789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f6d025314d4b35a7b06acb64ec74a5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:52.961748 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1376/2741] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:52.963669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:52.967712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:52.974014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1366/2742] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:52 2022] DELETE /identity/v3/users/c2f6d025314d4b35a7b06acb64ec74a5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:52.983638 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:52.983921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:52.984196 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.009344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:53.011102 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:53.061890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0425c85-aa7e-46b9-b801-e94f55b3a2a1 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.090250 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1367/2743] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:53.102531 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.104852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:53.138478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.139522 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.140049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.140552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.141539 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.144267 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.180594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1377/2744] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:52 2022] POST /identity/v3/users => generated 306 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:15:53.184242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.194658 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d72ebe-767f-47d3-96d0-f536b9631300 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.201540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.203461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08d102-a4e3-4d40-b0e1-026f91bda735 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.204050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.205283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.206927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.211375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.212176 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.212517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.212794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.213458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.215417 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.221609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.223571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.231085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1378/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:15:53.235979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.244099 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1368/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:53.248426 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4155e-4ca8-4f60-9254-ecfda7087cfe admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.253949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.254649 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.254932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.255203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] PATH_INFO: `/v3/projects/454538f1b59744ae8839c7e31c7caa59/users/27c33034105d44428613ffcfe53e2285/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.282305 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=454538f1b59744ae8839c7e31c7caa59, user_id=27c33034105d44428613ffcfe53e2285, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.285123 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.302713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1379/2747] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:53 2022] PUT /identity/v3/projects/454538f1b59744ae8839c7e31c7caa59/users/27c33034105d44428613ffcfe53e2285/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:15:53.307559 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.320637 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1797bab-2d09-41d8-bbbf-d3904e19ee59 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.390526 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:53.402081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.402735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.403664 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.403813 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.405066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.408095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202af11-38d1-4335-a527-981db529e808 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.433549 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.447704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1369/2748] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:53.453671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1ec1-b271-4976-bdcc-94c5e39ee45b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.477735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.478550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.478849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.479132 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] PATH_INFO: `/v3/projects/454538f1b59744ae8839c7e31c7caa59/users/27c33034105d44428613ffcfe53e2285/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.482499 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454538f1b59744ae8839c7e31c7caa59, user_id=27c33034105d44428613ffcfe53e2285, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.486949 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.503910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1380/2749] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:53 2022] PUT /identity/v3/projects/454538f1b59744ae8839c7e31c7caa59/users/27c33034105d44428613ffcfe53e2285/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:53.517351 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.518030 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.518431 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.563079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] MFA Rules not processed for user `27c33034105d44428613ffcfe53e2285`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:53.565207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:53.670598 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.675665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:53.688546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:53.718442 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1370/2750] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:53.731756 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.733203 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:53.794862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbb4b8-87cb-427c-b52f-1b5c30d94353 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.801746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.802761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.803244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.803761 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] PATH_INFO: `/v3/projects/0932d42a8f944065b4f06afefef3ded6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.806262 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0932d42a8f944065b4f06afefef3ded6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.808581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.809443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419eda8-7698-4e9a-8083-42c7d2ef7cff None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.815016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:53.815807 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:53.816187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:53.816313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:53.828795 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:53.831150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:53.843581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1371/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:53.887313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0932d42a8f944065b4f06afefef3ded6', 'request_id': 'req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:53.896324 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0932d42a8f944065b4f06afefef3ded6', 'request_id': 'req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:53.910272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0932d42a8f944065b4f06afefef3ded6', 'request_id': 'req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:53.921379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] The token cache is being invalidate because project 0932d42a8f944065b4f06afefef3ded6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:53.921686 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:53.922435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:53.924047 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1381/2752] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:53 2022] DELETE /identity/v3/projects/0932d42a8f944065b4f06afefef3ded6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:53.928265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.942353 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e042-42b1-4e95-a106-456644d872e6 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:53.969482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:53.970999 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:54.039995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:54.040775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:54.041170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:54.041370 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] PATH_INFO: `/v3/users/938c326239774f2a9ca8d431f6594cc5` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:54.042924 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938c326239774f2a9ca8d431f6594cc5)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:54.045227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:54.076027 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:54.079521 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fedcde-ffc8-4d9e-9ec7-02854f86bcf2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:54.086739 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:54.087817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:54.088557 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:54.088821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:54.092575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:54.119000 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938c326239774f2a9ca8d431f6594cc5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.119946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938c326239774f2a9ca8d431f6594cc5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.148458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938c326239774f2a9ca8d431f6594cc5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.180259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938c326239774f2a9ca8d431f6594cc5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.181031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938c326239774f2a9ca8d431f6594cc5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.192575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:54.203866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1372/2753] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:53 2022] DELETE /identity/v3/users/938c326239774f2a9ca8d431f6594cc5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:54.239465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:54.241643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa3f8-97b9-4f0d-8035-34eb2b57e800 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:54.255022 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1382/2754] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:15:54.659500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:54.662462 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:54.870678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552db60d-4dfd-4275-8b7a-a11e94d97967 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:54.888319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:54.889095 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:54.889385 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:54.889778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] PATH_INFO: `/v3/projects/5f1549528bc3445ab95eca3148fda5ff` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:54.898547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1549528bc3445ab95eca3148fda5ff)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:54.898547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:54.964289 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1549528bc3445ab95eca3148fda5ff', 'request_id': 'req-fccbfd66-5258-4f2d-9a5b-d68498c019f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.971791 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1549528bc3445ab95eca3148fda5ff', 'request_id': 'req-fccbfd66-5258-4f2d-9a5b-d68498c019f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.981874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1549528bc3445ab95eca3148fda5ff', 'request_id': 'req-fccbfd66-5258-4f2d-9a5b-d68498c019f9'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.994105 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] The token cache is being invalidate because project 5f1549528bc3445ab95eca3148fda5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:54.994439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:54.995086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-fccbfd66-5258-4f2d-9a5b-d68498c019f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:55.000198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1373/2755] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:54 2022] DELETE /identity/v3/projects/5f1549528bc3445ab95eca3148fda5ff => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:55.002126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.002684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.002795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.024591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:55.025814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:55.085425 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1383/2756] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:55.093641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.093931 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.094212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.116185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:55.118088 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:55.126379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1374/2757] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:55.130621 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.140370 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206da1c-e79b-43df-a774-75b6d3c42ce9 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.144973 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.145619 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.145897 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.146261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.146879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:15:55.147166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.148817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.161689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1384/2758] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:15:55.166644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.177165 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1444c-e164-46b4-8ddc-f40a8c1500fd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.184935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.185584 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.185866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.186364 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.187437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.190224 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.233602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1375/2759] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:15:55 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:55.234723 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.248173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3e8dd-b226-42e4-8aa5-a938858a2eaf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.312458 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.313414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.313869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.314373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.315023 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.316994 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.342471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1385/2760] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:15:55 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:15:55.346106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.355677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:55.362561 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff2b8d-7330-46f5-b618-627904e50b9d admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.369568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.370191 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.370738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.370871 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.371454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.373081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.389933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1376/2761] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:55.391517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.403734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f42c-e4fe-4c3b-b1e7-478f1efebf06 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.408713 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.409403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.409764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.410505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.411032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.412750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12458-739b-4373-86b6-8f01b7192de2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.425463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1386/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:15:55.430349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.440980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8d4fa-4cf5-41a6-89a3-9f8491730ccd admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.446001 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.446695 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.446971 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.447242 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] PATH_INFO: `/v3/projects/5622c780567b494ab3a97a270f59614d/users/addf3ff68ed2494ea35a275d58559033/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.462547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5622c780567b494ab3a97a270f59614d, user_id=addf3ff68ed2494ea35a275d58559033, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.465176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.480532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1377/2763] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:15:55 2022] PUT /identity/v3/projects/5622c780567b494ab3a97a270f59614d/users/addf3ff68ed2494ea35a275d58559033/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:55.491126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.491343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.491648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.520826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] MFA Rules not processed for user `addf3ff68ed2494ea35a275d58559033`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:55.522046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:55.571422 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:55.596112 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1387/2764] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:55.608123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:55.609856 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:55.667966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca701b-921c-4126-8e49-695531b4dfb3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:55.672296 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:55.672906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:55.673180 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:55.673448 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:55.682334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:55.683751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726c32-d40b-4365-9065-6e5956d46162 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:55.693125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1378/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:58.910990 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:58.913180 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:59.015674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e121aa-85fa-47d5-bd4a-7488f794c81b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:59.021865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:59.022755 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:59.023184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:59.023503 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] PATH_INFO: `/v3/users/84013f0a92b84e23acc53d5cf9a881f0` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:59.024855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84013f0a92b84e23acc53d5cf9a881f0)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:59.026956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:59.096096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84013f0a92b84e23acc53d5cf9a881f0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.103173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84013f0a92b84e23acc53d5cf9a881f0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.113758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84013f0a92b84e23acc53d5cf9a881f0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.131628 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84013f0a92b84e23acc53d5cf9a881f0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.132524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84013f0a92b84e23acc53d5cf9a881f0'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.152036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1388/2766] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:58 2022] DELETE /identity/v3/users/84013f0a92b84e23acc53d5cf9a881f0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:59.157103 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:59.157670 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:59.157796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:59.189451 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:15:59.190801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:59.262204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1379/2767] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:15:59.271894 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:59.274053 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:59.337738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812899-4dfd-45d3-a677-8587cfcc2c3c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:59.343602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:59.344276 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:59.344566 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:59.344864 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:59.356465 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:59.358001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:59.368320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1389/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:15:59.658400 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:59.660218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:15:59.690436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54eb61-7056-4cd0-aa3f-dae12993d183 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:59.695733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:59.696458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:59.696774 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:59.697055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] PATH_INFO: `/v3/projects/3697bf35f61f41e7b5d4bf197b645b6c` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:59.699514 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3697bf35f61f41e7b5d4bf197b645b6c)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:59.704143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:59.775546 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3697bf35f61f41e7b5d4bf197b645b6c', 'request_id': 'req-8724471b-58c6-49eb-9e63-5e74574a178a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.783126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3697bf35f61f41e7b5d4bf197b645b6c', 'request_id': 'req-8724471b-58c6-49eb-9e63-5e74574a178a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.795655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3697bf35f61f41e7b5d4bf197b645b6c', 'request_id': 'req-8724471b-58c6-49eb-9e63-5e74574a178a'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.800563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:59.813587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] The token cache is being invalidate because project 3697bf35f61f41e7b5d4bf197b645b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:15:59.814530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.815946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.820639 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1380/2769] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:15:59 2022] DELETE /identity/v3/projects/3697bf35f61f41e7b5d4bf197b645b6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:15:59.821914 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:15:59.827916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:15:59.834912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9727-ba29-4ae0-9d1c-0c22b1155df1 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:15:59.903027 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:15:59.903763 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:15:59.904166 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:15:59.904544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] PATH_INFO: `/v3/users/27c33034105d44428613ffcfe53e2285` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:15:59.905808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c33034105d44428613ffcfe53e2285)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:15:59.907870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:15:59.969992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c33034105d44428613ffcfe53e2285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.970744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c33034105d44428613ffcfe53e2285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.982854 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c33034105d44428613ffcfe53e2285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.996925 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c33034105d44428613ffcfe53e2285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:15:59.997656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-086f1727-ed2b-437d-90c6-629962025bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c33034105d44428613ffcfe53e2285'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.020072 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1390/2770] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:15:59 2022] DELETE /identity/v3/users/27c33034105d44428613ffcfe53e2285 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:00.343655 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:00.345188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:00.360305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724471b-58c6-49eb-9e63-5e74574a178a admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:00.443466 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:00.444124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.444401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.444681 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] PATH_INFO: `/v3/projects/454538f1b59744ae8839c7e31c7caa59` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.449019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454538f1b59744ae8839c7e31c7caa59)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:00.450302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:00.550340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454538f1b59744ae8839c7e31c7caa59', 'request_id': 'req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.562912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454538f1b59744ae8839c7e31c7caa59', 'request_id': 'req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.573160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454538f1b59744ae8839c7e31c7caa59', 'request_id': 'req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.586793 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] The token cache is being invalidate because project 454538f1b59744ae8839c7e31c7caa59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:00.587164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.587768 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-072e7cf9-f1d1-46b8-ac09-611a9c51b5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:00.589471 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1381/2771] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:00 2022] DELETE /identity/v3/projects/454538f1b59744ae8839c7e31c7caa59 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:00.594859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.595203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.595410 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.619418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:00.626880 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:00.711193 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1391/2772] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:00.729825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.730937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.734897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.760331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:00.762154 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:00.769701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1382/2773] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:00.774234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:00.786516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d80d-ecc0-4663-90b6-f52338a84f97 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:00.794235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:00.794895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.795102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.795345 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.796208 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:00.796481 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:00.798085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:00.824095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1392/2774] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:16:00.825313 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:00.835630 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aee65-25c9-4211-8784-856fd8b063ab None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:00.843003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:00.844066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.844590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.845057 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.845715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:00.847779 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:00.889693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1383/2775] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:00 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:00.894590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:00.914385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648194-b660-4859-abc8-598b84573e73 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:00.927978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:00.996024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:00.996701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:00.997157 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:00.997502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:00.998275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.000519 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.028776 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1393/2776] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:00 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:01.032502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.049070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac8ac-6027-44e6-8aa3-32f732b2ad7c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.057015 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.057847 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.058194 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.058582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.059305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.060957 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.078537 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1384/2777] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:01.084018 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.095679 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612930-06a0-4e57-bf24-4a996d42b10b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.103734 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.104192 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.104470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.104743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.105396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.107032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3d43d-79b3-4f66-ab91-6601d90f2efb admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.118516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1394/2778] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:01.123143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.135162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455b5b-3f00-45e2-8c13-51979c9c2504 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.144174 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.144923 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.145206 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.145482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] PATH_INFO: `/v3/projects/d4e7ddb9e02041ba95d32891e36d21d2/users/e0368c807d4d4c45bbc1254a44597458/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.166079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e7ddb9e02041ba95d32891e36d21d2, user_id=e0368c807d4d4c45bbc1254a44597458, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.168769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.194291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1385/2779] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:01 2022] PUT /identity/v3/projects/d4e7ddb9e02041ba95d32891e36d21d2/users/e0368c807d4d4c45bbc1254a44597458/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:01.198709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.198992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.199263 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.231111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] MFA Rules not processed for user `e0368c807d4d4c45bbc1254a44597458`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:01.232239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:01.323745 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1395/2780] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:01.328284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.365952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:01.450568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34fa29-037b-45e5-90a9-1af3299687cf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.456321 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.456533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.456741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.457006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.457803 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.459732 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.494911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1386/2781] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:01.496959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.508751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e46cb-20c7-45cb-939a-f7a8734651b1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.580709 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.581848 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.582142 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.582429 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.583085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.585016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.613308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1396/2782] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:01 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:01.614659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.632467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f53-91fd-48a3-9991-312d7de2b82b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.639481 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.640328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.640581 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.640859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.641701 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.643608 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.660916 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1387/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:16:01.662145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.675154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790491-5504-4693-8a9e-3b151201fff5 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.681460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.682280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.682634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.682956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.683780 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.686111 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3702a28-0bba-480b-97e7-345037215a9b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.690103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:01.724076 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1397/2784] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:01.729227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:01.743541 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c9d0b-a39b-4011-8990-e2d9dac0cac2 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:01.750460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:01.751217 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.751609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.751980 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] PATH_INFO: `/v3/projects/44e6001e12574446827b3e71616e8085/users/21a4b4d08b6e40238f1966c3def76d1b/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.778006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e6001e12574446827b3e71616e8085, user_id=21a4b4d08b6e40238f1966c3def76d1b, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:01.784051 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:01.804907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1388/2785] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:01 2022] PUT /identity/v3/projects/44e6001e12574446827b3e71616e8085/users/21a4b4d08b6e40238f1966c3def76d1b/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:01.879097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:01.879474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:01.879721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:01.912560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] MFA Rules not processed for user `21a4b4d08b6e40238f1966c3def76d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:01.913886 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:01.984954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1398/2786] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:01.990051 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.069152 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171145-4630-4d53-a7c8-1b82a1b05fcb admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.078869 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.080026 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.080995 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.081799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.093884 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.096728 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.137528 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1389/2787] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:02.142068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.155254 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24acf8d-128d-4513-9f69-6ae679d50f88 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.218882 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.219494 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.219773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.220071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.220701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.224548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.249830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1399/2788] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:02 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:02.254477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.266317 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add34ad0-812f-4138-b672-e66031e51af8 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.280428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.281055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.281373 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.281669 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.282311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.283922 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.299387 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1390/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:16:02.300959 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.312242 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e167-5709-49da-aea6-8df4407df624 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.317121 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.317908 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.318303 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.318674 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] PATH_INFO: `/v3/projects/1593e551121349b5a6b111e6396223d1/users/eaf18136dad340c1b4a1aa2de78d0808/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.336032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1593e551121349b5a6b111e6396223d1, user_id=eaf18136dad340c1b4a1aa2de78d0808, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.338937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.362160 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1400/2790] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:02 2022] PUT /identity/v3/projects/1593e551121349b5a6b111e6396223d1/users/eaf18136dad340c1b4a1aa2de78d0808/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:02.363331 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.374769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d4b3-7348-4413-a047-c1a0b5524ed4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.419926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:02.447085 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.447776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.448065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.448372 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.449020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.450748 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.450913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.452790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.464625 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1391/2791] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:16:02.466133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.466595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650959ba-3b08-4728-b73e-c59c3791775c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.471230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.471869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.472150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.472961 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] PATH_INFO: `/v3/users/addf3ff68ed2494ea35a275d58559033` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.473550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addf3ff68ed2494ea35a275d58559033)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.475512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.477234 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3aafd-fcac-4c78-8a60-dfb1eab74ce3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.482136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.482830 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.483108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.483378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] PATH_INFO: `/v3/projects/1593e551121349b5a6b111e6396223d1/users/eaf18136dad340c1b4a1aa2de78d0808/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.485461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1593e551121349b5a6b111e6396223d1, user_id=eaf18136dad340c1b4a1aa2de78d0808, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.488233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ef134-06db-4b09-bd27-8218568b8ba3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.508162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1392/2792] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:02 2022] PUT /identity/v3/projects/1593e551121349b5a6b111e6396223d1/users/eaf18136dad340c1b4a1aa2de78d0808/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:02.520864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.521164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.521724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.546919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addf3ff68ed2494ea35a275d58559033'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:02.547995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addf3ff68ed2494ea35a275d58559033'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:02.549473 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:02.561147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] MFA Rules not processed for user `eaf18136dad340c1b4a1aa2de78d0808`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:02.562474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addf3ff68ed2494ea35a275d58559033'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:02.563876 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.581182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addf3ff68ed2494ea35a275d58559033'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:02.582656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5dd11f4b-e05c-47e3-a7ce-f003ac11b765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addf3ff68ed2494ea35a275d58559033'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:02.597695 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1401/2793] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:02 2022] DELETE /identity/v3/users/addf3ff68ed2494ea35a275d58559033 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:02.602842 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.603127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.603403 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.625006 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:02.626223 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.653482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1393/2794] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:02.664985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.667028 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.725447 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1402/2795] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:02.735870 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:02.737531 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.776068 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d046af-4142-40ec-8729-f7133f235f07 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.820667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac78a3-9935-44d6-858f-65a0b7b1d16b None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:02.835266 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.835940 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.836225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.837376 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.852609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:02.853735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:02.854332 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.855474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:02.855812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:02.856065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.858135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:02.872257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1403/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:16:02.891325 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:02.953326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:02.955460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06675c-ddfc-456a-b051-3e8b4f7cb3f4 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:02.968894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1394/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:16:03.196796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.198793 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:03.220560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa1e93-7340-46d8-aafe-2a3f1d37cc2d service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.232818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.235103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.235456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.236247 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] PATH_INFO: `/v3/projects/5622c780567b494ab3a97a270f59614d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.239207 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5622c780567b494ab3a97a270f59614d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.243054 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.350690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5622c780567b494ab3a97a270f59614d', 'request_id': 'req-df86997b-87e7-4beb-9029-72a528dcb199'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:03.373085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5622c780567b494ab3a97a270f59614d', 'request_id': 'req-df86997b-87e7-4beb-9029-72a528dcb199'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:03.387502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5622c780567b494ab3a97a270f59614d', 'request_id': 'req-df86997b-87e7-4beb-9029-72a528dcb199'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:03.393669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:03.423489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] The token cache is being invalidate because project 5622c780567b494ab3a97a270f59614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:03.423783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:03.424796 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-df86997b-87e7-4beb-9029-72a528dcb199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:03.430931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1404/2798] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:03 2022] DELETE /identity/v3/projects/5622c780567b494ab3a97a270f59614d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:03.433983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.434778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.434778 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.487173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:03.489716 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:03.590570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1395/2799] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:03.598454 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.598744 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.599019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.652306 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:03.653596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:03.668082 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1405/2800] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:03.668765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.682678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c172-1827-4c4c-9020-9e827c7c9633 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.694437 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.712905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.731460 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1396/2801] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:16:03.732594 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.744939 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4f78-0e7e-4c3e-803f-1265cc134526 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.759443 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.760071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.761014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.761014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.761237 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.763590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.806632 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1406/2802] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:03 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:03.813921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.825173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ba25c-51b6-48e0-b4ca-1b726fc1beac admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.888943 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.889545 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.889824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.890094 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.890751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.892626 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.916975 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1397/2803] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:03 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:03.921434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.932552 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70f327-9f01-46af-84f1-f72b37a2a204 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.937187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.937785 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.938066 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.938375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.939017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.940615 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.951034 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1407/2804] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:03.955219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.965200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c6df-3931-47e3-aca5-4eb55cac71dc admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:03.970314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:03.970921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:03.971204 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:03.971479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:03.972125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:03.973719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620852-8336-4c04-824a-0f03b386b38b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:03.984555 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1398/2805] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:03.988866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:03.999569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645d3f-2e81-4c32-8670-93ecd4642d99 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:04.004210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:04.004858 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:04.005138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:04.005415 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] PATH_INFO: `/v3/projects/2922e36d21c64800b791ff3549cf87f4/users/21b2ea70d7aa40d6a2da651159c102d6/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:04.020538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2922e36d21c64800b791ff3549cf87f4, user_id=21b2ea70d7aa40d6a2da651159c102d6, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:04.023260 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:04.037014 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1408/2806] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:03 2022] PUT /identity/v3/projects/2922e36d21c64800b791ff3549cf87f4/users/21b2ea70d7aa40d6a2da651159c102d6/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:04.047535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:04.047816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:04.048086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:04.077659 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] MFA Rules not processed for user `21b2ea70d7aa40d6a2da651159c102d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:04.078911 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:04.096612 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:04.158717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1399/2807] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:04.181210 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:04.182956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:04.245342 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c745b-310f-4733-86d6-d89305189405 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:04.249064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:04.249675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:04.249956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:04.250227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:04.259257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:04.260691 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:04.273474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1409/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:04.788388 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:04.790413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:04.898825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32139e-a01b-4c18-a06b-61bae8395879 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:04.907797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:04.909429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:04.910469 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:04.911534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:04.915438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:04.991167 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:04.998507 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a476f7-95ee-482d-909b-73dd7cc58a11 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:05.011461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1400/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:05.720538 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:05.730528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e01b0-e6d0-414d-8e3f-d10852659e8a service glance] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:05.734161 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:05.734788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:05.735069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:05.735346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:05.737068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:05.799185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:05.800634 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:05.811033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1410/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:06.345354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a570558-b231-4818-9d39-491c37adb014 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:06.345834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a570558-b231-4818-9d39-491c37adb014 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:06.345952 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a570558-b231-4818-9d39-491c37adb014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:06.366991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2a570558-b231-4818-9d39-491c37adb014 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:06.368216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a570558-b231-4818-9d39-491c37adb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:06.426634 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1401/2811] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:06.439392 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:06.440899 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:06.464794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:06.524688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9a5b-713a-44eb-8678-7da8dda243eb service cinder] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:06.531095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:06.531760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:06.532225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:06.532418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:06.543670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:06.546827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:06.556646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1411/2812] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:16:08.607859 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a570558-b231-4818-9d39-491c37adb014 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:08.609334 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2a570558-b231-4818-9d39-491c37adb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:08.633640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=100 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:08.696891 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a570558-b231-4818-9d39-491c37adb014 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:08.709039 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:08.709724 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:08.710009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:08.710874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] PATH_INFO: `/v3/users/997df53b467c4e24b8d5d14a493b33ab` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:08.714530 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=997df53b467c4e24b8d5d14a493b33ab)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:08.718611 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:08.783319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997df53b467c4e24b8d5d14a493b33ab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:08.784111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997df53b467c4e24b8d5d14a493b33ab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:08.794172 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997df53b467c4e24b8d5d14a493b33ab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:08.807249 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997df53b467c4e24b8d5d14a493b33ab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:08.808218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-72b09921-6fde-46ac-85d1-49fb92fd5baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997df53b467c4e24b8d5d14a493b33ab'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:08.833984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1402/2813] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:08 2022] DELETE /identity/v3/users/997df53b467c4e24b8d5d14a493b33ab => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:09.033000 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.046555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536193cf-42ff-4e23-be77-22ed7b53f0cb service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.111391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.112029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.112308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.112582 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] PATH_INFO: `/v3/projects/7620ce2415ad41b2b219314e664d1c77` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.113690 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7620ce2415ad41b2b219314e664d1c77)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.115620 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.167893 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7620ce2415ad41b2b219314e664d1c77', 'request_id': 'req-1c625bb6-6db7-4029-90ee-8455983b6d8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.175606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7620ce2415ad41b2b219314e664d1c77', 'request_id': 'req-1c625bb6-6db7-4029-90ee-8455983b6d8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.183058 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7620ce2415ad41b2b219314e664d1c77', 'request_id': 'req-1c625bb6-6db7-4029-90ee-8455983b6d8d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.193569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] The token cache is being invalidate because project 7620ce2415ad41b2b219314e664d1c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:09.193855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.194527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-1c625bb6-6db7-4029-90ee-8455983b6d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.196555 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1412/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:09 2022] DELETE /identity/v3/projects/7620ce2415ad41b2b219314e664d1c77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:09.201754 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.202049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.202501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.222087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:09.223340 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:09.286177 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1403/2815] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:09.294395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.294560 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.294771 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.315046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:09.316280 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:09.325084 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1413/2816] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:09.329801 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.339590 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337c70-13d2-49d6-999e-f48c53c3a0fd None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.344477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.345078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.345360 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.345632 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.346299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:09.346606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.348376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.361320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1404/2817] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:16:09.365957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.375981 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338d59-36f3-4045-9ffe-a25b0c2fecc1 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.380767 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.381411 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.381694 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.381970 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.382692 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.384602 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.412855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1414/2818] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:09.417782 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.427986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09fd04-6a28-4e30-b091-4e641eb3f099 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.451972 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:09.500796 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.501413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.501693 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.501973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.502661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.504564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.527329 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1405/2819] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:16:09.531629 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.542543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81870820-b007-4a7a-9f91-12a83bee769d admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.547009 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.547606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.547883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.548152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.548798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.550404 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.551944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:09.564983 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1415/2820] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:09.568951 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.579233 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab798-68c5-4127-9391-aed418478cf0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.584121 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.584740 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.585024 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.585301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.585954 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.587594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfa8f0-e27c-4747-a8cd-6089be2b89d2 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.599062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1406/2821] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:09.604185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.614490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c592-1d3c-44b3-87b2-886ccec8c9ce admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.619798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.620540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.620735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.621033 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] PATH_INFO: `/v3/projects/b4a4f09774b1428082b2c886e371e684/users/6b07a80c17fc4f42816aee83dd52fdde/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.635791 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4f09774b1428082b2c886e371e684, user_id=6b07a80c17fc4f42816aee83dd52fdde, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.638490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.652823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1416/2822] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:09 2022] PUT /identity/v3/projects/b4a4f09774b1428082b2c886e371e684/users/6b07a80c17fc4f42816aee83dd52fdde/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:09.660368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.660368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.660368 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.678021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:09.679933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:09.741214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1407/2823] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:09.751221 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.752971 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:09.804013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:09.805464 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:09.817150 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855565-76ec-4485-921b-62b9c9d1ad3c None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.818474 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3611d4-e6fd-4192-bd2d-6672a517f5a2 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:09.822137 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.822461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:09.822852 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.823096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.823205 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.823338 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.823439 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] PATH_INFO: `/v3/users/e0368c807d4d4c45bbc1254a44597458` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.823609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.824542 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0368c807d4d4c45bbc1254a44597458)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.826487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.835148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:09.838599 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf48ac-8847-4060-bbd5-a6cf9dc3273d service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:09.850550 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1417/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:09.890055 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0368c807d4d4c45bbc1254a44597458'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.891222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0368c807d4d4c45bbc1254a44597458'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.903089 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0368c807d4d4c45bbc1254a44597458'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.924773 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0368c807d4d4c45bbc1254a44597458'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.925533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0368c807d4d4c45bbc1254a44597458'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:09.945809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1408/2825] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:09 2022] DELETE /identity/v3/users/e0368c807d4d4c45bbc1254a44597458 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:09.950537 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:09.951147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:09.951147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:09.972659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:09.973857 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:10.068271 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1418/2826] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:10.084568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:10.086862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:10.111416 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:10.168867 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bc715-36ce-4f26-9f76-9e355c86f02c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:10.176059 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:10.176948 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:10.177319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:10.177715 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:10.188554 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:10.190033 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:10.201126 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1409/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:10.538219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:10.539855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:10.561590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ea20-393c-4f59-a12a-1be1f72b09c6 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:10.567638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:10.568460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:10.568839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:10.569010 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] PATH_INFO: `/v3/projects/d4e7ddb9e02041ba95d32891e36d21d2` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:10.571110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e7ddb9e02041ba95d32891e36d21d2)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:10.573395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:10.627660 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e7ddb9e02041ba95d32891e36d21d2', 'request_id': 'req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.637275 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e7ddb9e02041ba95d32891e36d21d2', 'request_id': 'req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.645311 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e7ddb9e02041ba95d32891e36d21d2', 'request_id': 'req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.652946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:10.660604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] The token cache is being invalidate because project d4e7ddb9e02041ba95d32891e36d21d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:10.661201 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.663048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.664614 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1419/2828] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:10 2022] DELETE /identity/v3/projects/d4e7ddb9e02041ba95d32891e36d21d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:10.669432 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:10.680291 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fde147-dd54-4670-989f-f23ec3c5ab2c service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:10.750495 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:10.751144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:10.751477 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:10.751755 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] PATH_INFO: `/v3/users/21a4b4d08b6e40238f1966c3def76d1b` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:10.752894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a4b4d08b6e40238f1966c3def76d1b)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:10.754858 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:10.809302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a4b4d08b6e40238f1966c3def76d1b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.810374 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a4b4d08b6e40238f1966c3def76d1b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.818836 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a4b4d08b6e40238f1966c3def76d1b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.835606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a4b4d08b6e40238f1966c3def76d1b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.837006 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a4b4d08b6e40238f1966c3def76d1b'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:10.855201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1410/2829] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:10 2022] DELETE /identity/v3/users/21a4b4d08b6e40238f1966c3def76d1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:11.206512 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:11.208029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:11.241096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90fe5d-bed5-4258-bd8b-5a6c74edd070 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:11.356468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:11.358932 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:11.364102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:11.364866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] PATH_INFO: `/v3/projects/44e6001e12574446827b3e71616e8085` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:11.367162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e6001e12574446827b3e71616e8085)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:11.369331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:11.439496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e6001e12574446827b3e71616e8085', 'request_id': 'req-6c44bcb0-b195-4a47-b1d0-e48e426c9192'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.454460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e6001e12574446827b3e71616e8085', 'request_id': 'req-6c44bcb0-b195-4a47-b1d0-e48e426c9192'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.463155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e6001e12574446827b3e71616e8085', 'request_id': 'req-6c44bcb0-b195-4a47-b1d0-e48e426c9192'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.485876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] The token cache is being invalidate because project 44e6001e12574446827b3e71616e8085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:11.486485 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.487687 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.489849 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1420/2830] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:11 2022] DELETE /identity/v3/projects/44e6001e12574446827b3e71616e8085 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:11.494197 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:11.495759 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:11.518016 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ff1b8-3952-4b0c-ab06-c03182ed5c7b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:11.564004 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:11.596155 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:11.597283 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:11.597645 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:11.598077 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] PATH_INFO: `/v3/users/eaf18136dad340c1b4a1aa2de78d0808` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:11.602468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf18136dad340c1b4a1aa2de78d0808)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:11.604403 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:11.668069 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf18136dad340c1b4a1aa2de78d0808'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.668977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf18136dad340c1b4a1aa2de78d0808'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.677988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf18136dad340c1b4a1aa2de78d0808'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.695185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf18136dad340c1b4a1aa2de78d0808'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.696113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-8db7deaa-f1eb-4ada-966b-00759d122ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf18136dad340c1b4a1aa2de78d0808'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:11.729208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1411/2831] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:11 2022] DELETE /identity/v3/users/eaf18136dad340c1b4a1aa2de78d0808 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:12.154698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.156883 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:12.174595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bcb0-b195-4a47-b1d0-e48e426c9192 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.245689 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.246475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.246592 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.246813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] PATH_INFO: `/v3/projects/1593e551121349b5a6b111e6396223d1` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.248040 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1593e551121349b5a6b111e6396223d1)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.249957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:12.301703 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:12.320910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1593e551121349b5a6b111e6396223d1', 'request_id': 'req-e1a40252-677e-496c-946a-fa8505a783b4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:12.330642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1593e551121349b5a6b111e6396223d1', 'request_id': 'req-e1a40252-677e-496c-946a-fa8505a783b4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:12.337967 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1593e551121349b5a6b111e6396223d1', 'request_id': 'req-e1a40252-677e-496c-946a-fa8505a783b4'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:12.355505 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] The token cache is being invalidate because project 1593e551121349b5a6b111e6396223d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:12.360740 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:12.362680 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-e1a40252-677e-496c-946a-fa8505a783b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:12.371429 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.371840 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.372236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.373320 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1421/2832] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:12 2022] DELETE /identity/v3/projects/1593e551121349b5a6b111e6396223d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:12.410735 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:12.415476 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:12.520073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1412/2833] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:12.544554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.545470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.545470 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.570641 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:12.571915 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:12.582483 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1422/2834] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:12.587132 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.598302 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7998-9850-429c-b877-a38641b6d526 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.607553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.607553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.607553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.607553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.608472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:12.609013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.611212 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:12.626733 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1413/2835] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:16:12.631382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.641678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ebf5-b7b8-4b40-8a18-0947cdbcf810 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.646859 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.647490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.647892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.648261 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.649194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.651670 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:12.689633 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1423/2836] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:16:12.694297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.712145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e457bc8-0f88-4aa0-953f-0aae9aa996b3 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.819926 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:12.865162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9140346-0697-4155-a381-42080f870add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.865906 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140346-0697-4155-a381-42080f870add admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.866941 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140346-0697-4155-a381-42080f870add admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.867326 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140346-0697-4155-a381-42080f870add admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.868176 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9140346-0697-4155-a381-42080f870add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.872897 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9140346-0697-4155-a381-42080f870add admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:12.906883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1414/2837] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:12 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:12.911257 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.929203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40148a8-857c-4b96-b691-6ffd3b1912fa admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.935186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.936643 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.937293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.937839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.938835 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.940773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:12.963644 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9140346-0697-4155-a381-42080f870add admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:12.973143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1424/2838] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:12.979966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9140346-0697-4155-a381-42080f870add admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:12.985500 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:12.986605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:12.987108 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:12.987682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:12.988573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:12.990459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ad629-dace-4380-8cfa-1bfbcc1088d4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:13.012487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1415/2839] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:13.015833 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:13.031891 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906533e0-9b43-443d-bd3c-cdb2762033ef admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:13.039669 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:13.040369 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:13.040650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:13.040933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] PATH_INFO: `/v3/projects/7391475059404021869e01657a729e36/users/19f8ef0512a74f88abda832149750d18/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:13.060617 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7391475059404021869e01657a729e36, user_id=19f8ef0512a74f88abda832149750d18, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:13.064182 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:13.086453 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1425/2840] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:13 2022] PUT /identity/v3/projects/7391475059404021869e01657a729e36/users/19f8ef0512a74f88abda832149750d18/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:13.097113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:13.097452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:13.097673 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:13.133501 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] MFA Rules not processed for user `19f8ef0512a74f88abda832149750d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:13.137443 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:13.230427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1416/2841] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:13.243106 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:13.245162 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:13.332930 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9366df-a0b1-4f8b-8dae-385be9993707 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:13.341430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:13.345903 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:13.346489 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:13.346865 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:13.362234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:13.367148 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a1178-74b3-4cde-8b4b-8804ea1da510 service cinder] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:13.390065 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1426/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:13.445215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:13.607482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34bba-8eea-44e1-a329-4bd54606f4f1 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:13.620215 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:13.626591 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:13.627125 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:13.627570 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] PATH_INFO: `/v3/users/19f8ef0512a74f88abda832149750d18` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:13.629762 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f8ef0512a74f88abda832149750d18)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:13.631763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:13.711472 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f8ef0512a74f88abda832149750d18'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:13.713486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f8ef0512a74f88abda832149750d18'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:13.721893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:13.729430 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f8ef0512a74f88abda832149750d18'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:13.768987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f8ef0512a74f88abda832149750d18'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:13.770110 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f8ef0512a74f88abda832149750d18'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:13.798440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1417/2843] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:13 2022] DELETE /identity/v3/users/19f8ef0512a74f88abda832149750d18 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:13.803110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876129-0007-4679-bee9-95401f19e999 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:13.803676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876129-0007-4679-bee9-95401f19e999 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:13.804730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876129-0007-4679-bee9-95401f19e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:13.831314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-5b876129-0007-4679-bee9-95401f19e999 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:13.833389 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b876129-0007-4679-bee9-95401f19e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:13.905624 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:13.917992 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1427/2844] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:13.928189 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:13.930428 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:14.017444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4da3-91d5-473f-aa90-0845baa5223c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:14.021489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:14.022112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:14.022425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:14.023259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:14.033540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:14.035005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:14.047391 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1418/2845] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:14.404352 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876129-0007-4679-bee9-95401f19e999 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:14.406927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-5b876129-0007-4679-bee9-95401f19e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:14.427145 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876129-0007-4679-bee9-95401f19e999 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:14.440118 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:14.441282 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:14.442019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:14.442524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] PATH_INFO: `/v3/projects/7391475059404021869e01657a729e36` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:14.444243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7391475059404021869e01657a729e36)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:14.447895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:14.521149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7391475059404021869e01657a729e36', 'request_id': 'req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:14.532139 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7391475059404021869e01657a729e36', 'request_id': 'req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:14.541216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7391475059404021869e01657a729e36', 'request_id': 'req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:14.555096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] The token cache is being invalidate because project 7391475059404021869e01657a729e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:14.555390 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:14.556069 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f37e4c4f-1ef0-4617-a7dc-3a5c03791f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:14.557850 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1428/2846] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:14 2022] DELETE /identity/v3/projects/7391475059404021869e01657a729e36 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:14.834571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:14.837944 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:14.858502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f4ba-d1a3-45e4-9543-ab2019c12b90 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:14.969575 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:14.970535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:14.970977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:14.971418 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] PATH_INFO: `/v3/users/a389be3e9fc249979aac8e8dece934bc` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:14.972797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a389be3e9fc249979aac8e8dece934bc)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:14.975018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.040572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a389be3e9fc249979aac8e8dece934bc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:15.042413 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a389be3e9fc249979aac8e8dece934bc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:15.066328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a389be3e9fc249979aac8e8dece934bc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:15.098678 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a389be3e9fc249979aac8e8dece934bc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:15.099492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-dc584368-6cdd-47c2-a220-4fe14b805d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a389be3e9fc249979aac8e8dece934bc'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:15.102459 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:15.130018 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1419/2847] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:14 2022] DELETE /identity/v3/users/a389be3e9fc249979aac8e8dece934bc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:15.134784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.135138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.135487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.166147 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:15.167518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:15.276527 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.276828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.277112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.281517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1429/2848] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:15.291646 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.292638 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:15.318822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] MFA Rules not processed for user `6b07a80c17fc4f42816aee83dd52fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:15.322593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:15.370912 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb429d-92d8-4eab-b33e-fcea362688cb None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.379220 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.379996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.380821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.381131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.393393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.394979 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.411122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1430/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:16:15.437964 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1420/2850] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:15.442736 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.445575 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:15.476382 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116860fe-a5ce-4429-9bbd-c7a0b5715d64 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.483158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.483808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.484158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.484445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.485294 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.490750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.536651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1431/2851] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:15 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:15.541064 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.557333 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeace91-f0ac-4f36-ba69-3cde11ab101f None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.661288 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.661969 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.662273 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.662614 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.663376 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.665248 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.689145 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1421/2852] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:15 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:15.693957 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.707784 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:15.722225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855c1ab-fa5f-4c97-8738-434ef8244f5b admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.729805 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.730918 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.731236 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.731639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.732501 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.734375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.747051 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1432/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:15.751261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.764227 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da09e1-968f-4e10-95df-6a4781c372d4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.771200 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.772092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.772571 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.772990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] PATH_INFO: `/v3/projects/db4863651732475a92863d5e0d9ed4bc/users/1bbab3d8c37d4953accbc00af8137571/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.806124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4863651732475a92863d5e0d9ed4bc, user_id=1bbab3d8c37d4953accbc00af8137571, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.809237 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.831114 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1422/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:15 2022] PUT /identity/v3/projects/db4863651732475a92863d5e0d9ed4bc/users/1bbab3d8c37d4953accbc00af8137571/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:15.836427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.852160 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.856540 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:15.864326 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bae33e-4d75-49d5-955e-9378018ef28c admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.930606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:15.948866 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4dc3e-ad20-46c9-b11a-eebb616bef13 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.955009 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.955729 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.956079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.956417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] PATH_INFO: `/v3/projects/1a89f217f6c94117a95643e7f6b3d23f` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.957685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a89f217f6c94117a95643e7f6b3d23f)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.959628 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.961719 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.962361 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.962671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.962944 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:15.963581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:15.965190 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:15.978885 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1433/2855] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:16:15.979987 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:15.990551 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3638a6-81b3-4907-871f-0fc9df286f09 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:15.997130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:15.997741 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:15.998039 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:15.998340 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] PATH_INFO: `/v3/projects/db4863651732475a92863d5e0d9ed4bc/users/1bbab3d8c37d4953accbc00af8137571/roles/501008bc08bd430ea940373b81e53c53` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.000357 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4863651732475a92863d5e0d9ed4bc, user_id=1bbab3d8c37d4953accbc00af8137571, role_id=501008bc08bd430ea940373b81e53c53)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.003092 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb048df9-81aa-405f-af0c-991b9b4eb4bc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.013013 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a89f217f6c94117a95643e7f6b3d23f', 'request_id': 'req-236c78d6-a675-4604-83bf-390695b89bff'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:16.016158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1434/2856] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:15 2022] PUT /identity/v3/projects/db4863651732475a92863d5e0d9ed4bc/users/1bbab3d8c37d4953accbc00af8137571/roles/501008bc08bd430ea940373b81e53c53 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:16.020671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a89f217f6c94117a95643e7f6b3d23f', 'request_id': 'req-236c78d6-a675-4604-83bf-390695b89bff'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:16.029920 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a89f217f6c94117a95643e7f6b3d23f', 'request_id': 'req-236c78d6-a675-4604-83bf-390695b89bff'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:16.043314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] The token cache is being invalidate because project 1a89f217f6c94117a95643e7f6b3d23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:16.043605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:16.044305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-236c78d6-a675-4604-83bf-390695b89bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:16.046146 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1423/2857] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:15 2022] DELETE /identity/v3/projects/1a89f217f6c94117a95643e7f6b3d23f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:16.051191 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.051482 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.051772 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.073651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:16.075050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:16.165293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1435/2858] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:16.174741 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.175144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.175357 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.208235 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:16.210252 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:16.224444 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1424/2859] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:16.229822 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.242302 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa9e0-6331-4931-b7d7-eb2578c48860 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.249816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.250516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.250779 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.251105 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.251831 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:16.252143 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.253988 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.271277 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1436/2860] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:16:16.272482 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.282467 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012b05-040f-47a4-91aa-6ee36b777f25 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.287435 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.288070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.288843 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.289117 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.289775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.291781 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.325979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1425/2861] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:16 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:16.330394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.345243 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467466-bf08-4b6a-8ce4-6e15493ba41e admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.417446 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.418933 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.419225 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.419645 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.420337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.422337 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.436516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:16.455569 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1437/2862] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:16 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:16.463010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.477238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67b6a-dfa4-44c9-8705-4196ca4566cf admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.482491 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.483142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.483426 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.483763 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.484492 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.486280 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.502394 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1426/2863] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:16.504839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.515596 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1a39-2532-412a-b1d5-fb15d0f639c8 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.521144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.521863 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.522149 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.523094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.523764 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.525845 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ce69-aeac-46ab-9de2-318b650143c1 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.537490 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1438/2864] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:16.541927 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.553065 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498278-c3df-4f66-a772-09c58de78412 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.566775 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.567539 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.567839 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.568218 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] PATH_INFO: `/v3/projects/76f268d0033d413c94c64fc2e8a07023/users/67935c5454194de6be41c023438ed0d5/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.589547 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f268d0033d413c94c64fc2e8a07023, user_id=67935c5454194de6be41c023438ed0d5, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.593844 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.611633 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1427/2865] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:16 2022] PUT /identity/v3/projects/76f268d0033d413c94c64fc2e8a07023/users/67935c5454194de6be41c023438ed0d5/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:16.622732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce62e7-2ab2-47f0-92fa-cab2b96e1ca0 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.623043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce62e7-2ab2-47f0-92fa-cab2b96e1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.623351 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce62e7-2ab2-47f0-92fa-cab2b96e1ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.667508 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-1bce62e7-2ab2-47f0-92fa-cab2b96e1ca0 None None] MFA Rules not processed for user `67935c5454194de6be41c023438ed0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:16.669333 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-1bce62e7-2ab2-47f0-92fa-cab2b96e1ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:16.758911 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1439/2866] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:16.779395 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:16.782396 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:16.896255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22b98a-db24-4443-99ce-f6b24f83a8d0 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:16.903635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:16.905144 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:16.906056 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:16.906983 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:16.923381 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:16.926704 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:16.946029 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1428/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:18.471843 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:18.472826 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:18.473580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:18.499373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] MFA Rules not processed for user `67935c5454194de6be41c023438ed0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:18.501127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:18.521533 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1440/2868] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:18.565692 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:18.567521 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:18.593605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:18.641553 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd891-484d-4d36-8942-9c00dc75e76f service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:18.645797 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4480ebef3a0f4a2cb5a2508ff9e0ded0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:18.646563 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:18.646946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:18.647320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:18.650578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:18.820880 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:18.822689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202d07e-7f58-4b4e-a935-c5538c3e54d3 service glance] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:18.852937 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1429/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:19.904608 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:19.906527 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:20.042590 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfede-c5ae-437f-8985-a2bf80ab0c3f None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:20.046830 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:20.047666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:20.048097 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:20.048556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:20.050852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:20.071396 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:20.074152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:20.126509 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1441/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:22.442690 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1944e4-2602-4dc7-b512-e75b44da5476 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:22.443613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1944e4-2602-4dc7-b512-e75b44da5476 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:22.443935 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1944e4-2602-4dc7-b512-e75b44da5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:22.477328 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-2b1944e4-2602-4dc7-b512-e75b44da5476 None None] MFA Rules not processed for user `1bbab3d8c37d4953accbc00af8137571`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:22.478988 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2b1944e4-2602-4dc7-b512-e75b44da5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:22.562347 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1430/2871] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:22.580681 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:22.583313 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:22.620820 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e5dd0-4d37-475c-8152-982c6841c92b service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:22.628293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:22.630664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:22.631203 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:22.631708 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:22.635019 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:22.711270 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:22.715676 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:22.729878 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1442/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:24.136925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7823a-c4b6-4a84-be90-7ca67beb6453 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:24.137474 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7823a-c4b6-4a84-be90-7ca67beb6453 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:24.138629 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7823a-c4b6-4a84-be90-7ca67beb6453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:24.164708 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-37f7823a-c4b6-4a84-be90-7ca67beb6453 None None] MFA Rules not processed for user `6b07a80c17fc4f42816aee83dd52fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:24.165989 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-37f7823a-c4b6-4a84-be90-7ca67beb6453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:24.173446 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1431/2873] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:32.724457 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=2,keystone:SELECT=96 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:34.161092 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=83 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:35.532158 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:35.534434 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:35.630297 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5f07-6f67-40b0-90fb-c0aa4f35596e service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:35.642427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:35.643664 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:35.643954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:35.644235 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] PATH_INFO: `/v3/users/21b2ea70d7aa40d6a2da651159c102d6` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:35.645892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b2ea70d7aa40d6a2da651159c102d6)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:35.648541 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:35.724016 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b2ea70d7aa40d6a2da651159c102d6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:35.724866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b2ea70d7aa40d6a2da651159c102d6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:35.734032 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b2ea70d7aa40d6a2da651159c102d6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:35.753071 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b2ea70d7aa40d6a2da651159c102d6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:35.754154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b2ea70d7aa40d6a2da651159c102d6'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:35.770126 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1443/2874] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:35 2022] DELETE /identity/v3/users/21b2ea70d7aa40d6a2da651159c102d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:35.775198 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:35.775750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:35.775750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:35.798020 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:35.799319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:35.876133 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1432/2875] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:35.888650 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:35.890234 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:35.969087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eda0d-5b6d-404b-8d03-45897b7da529 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:35.974385 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:35.975122 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:35.975517 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:35.976055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:35.988504 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:35.990478 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df964a42-8a49-4764-a205-e4d671aa3c14 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:36.004074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1444/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:16:36.419052 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:36.431156 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:36.460089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.460758 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.461427 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.462689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa55ff-393d-45d8-a7b6-18406163d0f8 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:36.468744 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:36.469300 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.469479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.469799 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] PATH_INFO: `/v3/projects/2922e36d21c64800b791ff3549cf87f4` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.470890 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2922e36d21c64800b791ff3549cf87f4)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:36.472865 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:36.509553 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:36.512172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:36.522855 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2922e36d21c64800b791ff3549cf87f4', 'request_id': 'req-2aaa04a8-a43e-46fb-87aa-2bcc56569285'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:36.531344 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2922e36d21c64800b791ff3549cf87f4', 'request_id': 'req-2aaa04a8-a43e-46fb-87aa-2bcc56569285'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:36.539725 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:36.551536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2922e36d21c64800b791ff3549cf87f4', 'request_id': 'req-2aaa04a8-a43e-46fb-87aa-2bcc56569285'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:36.571411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] The token cache is being invalidate because project 2922e36d21c64800b791ff3549cf87f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:36.572229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:36.573401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-2aaa04a8-a43e-46fb-87aa-2bcc56569285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:36.577169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1433/2877] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:36 2022] DELETE /identity/v3/projects/2922e36d21c64800b791ff3549cf87f4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:36.582222 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45db-d12f-4949-84ef-0c06f0b6eedc None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.582653 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45db-d12f-4949-84ef-0c06f0b6eedc None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.582861 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45db-d12f-4949-84ef-0c06f0b6eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.599520 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1445/2878] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:36.605767 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-49ef45db-d12f-4949-84ef-0c06f0b6eedc None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:36.606734 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-49ef45db-d12f-4949-84ef-0c06f0b6eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:36.620705 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:36.622666 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:36.688960 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1434/2879] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 10:16:36.711984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcd2b3-f2aa-41d9-8de0-33dc99bc24ff None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:36.719170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:36.720074 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.720496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.720913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.732445 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:36.734138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:36.744322 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1446/2880] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 10:16:36.760031 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.760314 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.760589 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.786113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:36.788319 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:36.802350 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1435/2881] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:36.809283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:36.820540 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb783-2861-4d3c-8901-7f4bbbe16876 service swift] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:36.825746 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:36.826530 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.826813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.827090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.827777 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:16:36.828325 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:36.830477 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:36.847272 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1447/2882] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 10:16:36.852579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:36.863151 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad610e3-0dfe-45e1-8de0-f3222cae9d9a None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:36.868973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:36.869610 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:36.869905 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:36.870181 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:36.870883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:36.872825 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:36.892776 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:36.913535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1436/2883] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:16:36.917962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:36.930579 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3294-efaa-4def-9f59-67c4b99fc6cc admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.016735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.018004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.018394 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.018732 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.019463 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.022089 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.055359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1448/2884] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:16:36 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:16:37.059671 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:37.081050 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fe6c0-61a6-434d-bba2-b07e4c6c837b admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.086378 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.087084 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.087434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.087705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.088794 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.090461 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.106354 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1437/2885] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 10:16:37.109609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:37.121923 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9bbc-5d67-4e93-8fba-079df1887fc6 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.127839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.128673 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.128996 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.129172 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.129862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.131607 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6768a2-409e-45c2-a981-f344f7a9aee8 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.144547 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1449/2886] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:16:37.149558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:37.159914 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ef60-44ac-4a9c-9be9-06a4b057e09c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.165272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.170405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.170747 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.171115 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] PATH_INFO: `/v3/projects/d64de2b1589f458db6b7239098a8bc98/users/5c87e2301f4b4cf4ac67a8f97b02d145/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.192343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64de2b1589f458db6b7239098a8bc98, user_id=5c87e2301f4b4cf4ac67a8f97b02d145, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.196594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.220578 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1438/2887] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:16:37 2022] PUT /identity/v3/projects/d64de2b1589f458db6b7239098a8bc98/users/5c87e2301f4b4cf4ac67a8f97b02d145/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:16:37.225606 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ff38e-3c61-425f-bf86-f4b58cfa06f5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.225922 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ff38e-3c61-425f-bf86-f4b58cfa06f5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.226183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ff38e-3c61-425f-bf86-f4b58cfa06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.247900 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-366ff38e-3c61-425f-bf86-f4b58cfa06f5 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:37.249119 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-366ff38e-3c61-425f-bf86-f4b58cfa06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:37.269087 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:37.322529 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1450/2888] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:37.336275 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:37.338623 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:37.406107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f3f-a191-40a3-98bc-64eac7b3f879 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.407043 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f3f-a191-40a3-98bc-64eac7b3f879 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.407464 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f3f-a191-40a3-98bc-64eac7b3f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.434380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eee4c-f7d3-4f6b-9071-a0ab79f603e4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.438505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.439409 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.439694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.439968 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.456346 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.461536 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.472057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d9854f3f-a191-40a3-98bc-64eac7b3f879 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:37.473317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d9854f3f-a191-40a3-98bc-64eac7b3f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:37.481908 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1439/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:37.581502 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1451/2890] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:37.595427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:37.685585 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef872d-dc63-41bb-9a2e-f9ac4e21b8d4 service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:37.693307 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:37.694411 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:37.694925 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:37.696209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:37.712689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:37.715730 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:37.733518 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1440/2891] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:16:38.072698 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ee27c-8720-4452-a065-b8f46e2d8b45 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.073195 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ee27c-8720-4452-a065-b8f46e2d8b45 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.073535 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ee27c-8720-4452-a065-b8f46e2d8b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.104675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-dd4ee27c-8720-4452-a065-b8f46e2d8b45 None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:38.107048 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-dd4ee27c-8720-4452-a065-b8f46e2d8b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:38.120954 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1452/2892] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Sep 21 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:38.137532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:38.165320 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2f34f-3660-4cb9-b00a-e45bef70247a service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:38.172599 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:38.173232 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.173512 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.173788 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.185286 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:38.187694 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:38.198675 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1441/2893] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:16:38.373866 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e422-9f36-4f6f-8029-11cf7a0484c5 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.374360 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e422-9f36-4f6f-8029-11cf7a0484c5 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.376479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e422-9f36-4f6f-8029-11cf7a0484c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.412154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-3438e422-9f36-4f6f-8029-11cf7a0484c5 None None] MFA Rules not processed for user `5c87e2301f4b4cf4ac67a8f97b02d145`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:38.415245 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3438e422-9f36-4f6f-8029-11cf7a0484c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:38.505430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1453/2894] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:38.517772 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:38.519864 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:38.595620 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:38.644640 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063940-4af6-4f8b-9e86-2d9fbae9b8ff service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:38.654116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:38.654809 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.655221 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.655505 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.664183 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7466d-f234-461d-be86-39f98f2cda7f None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.665114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7466d-f234-461d-be86-39f98f2cda7f None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.665114 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7466d-f234-461d-be86-39f98f2cda7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.672427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:38.674049 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:38.685037 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1442/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:38.704626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-fea7466d-f234-461d-be86-39f98f2cda7f None None] MFA Rules not processed for user `d17d0df9842d415fa8512364e47532c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:38.706052 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-fea7466d-f234-461d-be86-39f98f2cda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:38.717462 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1454/2896] 10.222.0.20 () {58 vars in 967 bytes} [Wed Sep 21 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:38.742438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:38.764910 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092516-a428-4aa7-a8ad-a1da5d095182 service cinder] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:38.774593 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ed64582f5481f8e5c5c70bb901e0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:38.775783 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:38.776454 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:38.777046 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:38.793874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:38.797186 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:38.812812 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1443/2897] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Sep 21 10:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 10:16:40.183386 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf84-8a6c-4334-81df-c68b55ed89ab None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:40.183945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf84-8a6c-4334-81df-c68b55ed89ab None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:40.183945 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbcf84-8a6c-4334-81df-c68b55ed89ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:40.205675 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-c3bbcf84-8a6c-4334-81df-c68b55ed89ab None None] MFA Rules not processed for user `5c87e2301f4b4cf4ac67a8f97b02d145`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:40.207156 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-c3bbcf84-8a6c-4334-81df-c68b55ed89ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:40.214738 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1455/2898] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:41.139140 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:41.141497 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:41.158635 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779807fe-fef0-4b5c-9126-252db9817e2c service swift] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:41.165420 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:41.166074 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:41.166458 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:41.166738 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] PATH_INFO: `/v3/users/67935c5454194de6be41c023438ed0d5` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:41.167921 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=67935c5454194de6be41c023438ed0d5)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:41.169848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:41.247953 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67935c5454194de6be41c023438ed0d5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.248666 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67935c5454194de6be41c023438ed0d5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.256327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67935c5454194de6be41c023438ed0d5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.272663 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67935c5454194de6be41c023438ed0d5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.274330 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67935c5454194de6be41c023438ed0d5'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.294945 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1444/2899] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:16:41 2022] DELETE /identity/v3/users/67935c5454194de6be41c023438ed0d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:41.301518 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:41.302452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:41.302452 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:41.310570 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=100 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:41.323240 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:16:41.324975 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:41.417468 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1456/2900] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:16:41.432814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:41.434261 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:41.525688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b09d-1c92-47c1-8b12-9b94e902b7aa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:41.530201 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:41.530992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:41.531379 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:41.531808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:41.544366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:41.547303 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:41.558566 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1445/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:16:41.790049 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:41.791536 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:41.805430 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b93e-b419-45fa-b302-19983f776184 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:41.811375 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:41.812067 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:41.812435 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:41.812604 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] PATH_INFO: `/v3/projects/76f268d0033d413c94c64fc2e8a07023` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:41.813972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f268d0033d413c94c64fc2e8a07023)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:41.816013 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:41.915618 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f268d0033d413c94c64fc2e8a07023', 'request_id': 'req-da480c71-89cc-44e1-8dda-5bc9beaf4419'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.927801 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f268d0033d413c94c64fc2e8a07023', 'request_id': 'req-da480c71-89cc-44e1-8dda-5bc9beaf4419'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.942108 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f268d0033d413c94c64fc2e8a07023', 'request_id': 'req-da480c71-89cc-44e1-8dda-5bc9beaf4419'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.966135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] The token cache is being invalidate because project 76f268d0033d413c94c64fc2e8a07023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:16:41.966659 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.967640 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:16:41.969516 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1457/2902] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:16:41 2022] DELETE /identity/v3/projects/76f268d0033d413c94c64fc2e8a07023 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:16:44.010170 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:44.011697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:44.023594 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f939-3302-4a78-9002-63530c9a3a0c service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:44.057765 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:44.077111 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:44.077723 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:44.078003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:44.078297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:44.080178 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:44.089624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:44.091327 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a365be-bbd4-4b3b-a60f-ebd3c340fd31 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:44.099607 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1446/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:16:51.960600 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:54.095688 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=10 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:16:59.824068 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:16:59.825839 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:59.840749 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480c71-89cc-44e1-8dda-5bc9beaf4419 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:16:59.844760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:16:59.845373 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:16:59.845655 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:16:59.845934 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:16:59.847742 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:16:59.918657 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:16:59.920131 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:16:59.931173 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1458/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:09.925684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=30 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:17:12.955299 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5dde-271a-4e2d-a647-8d0df56e4161 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:12.955883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5dde-271a-4e2d-a647-8d0df56e4161 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:12.955883 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5dde-271a-4e2d-a647-8d0df56e4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:12.976162 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-5b9e5dde-271a-4e2d-a647-8d0df56e4161 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:12.977452 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-5b9e5dde-271a-4e2d-a647-8d0df56e4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:13.040479 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1447/2905] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:13.071904 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:13.073834 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:13.155170 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c9fb1-e740-4600-b0ca-3e06479697a5 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:13.160892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:13.161528 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:13.161808 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:13.162088 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:13.171544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:13.173137 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:13.183639 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1459/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:16.008719 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbb35-1fa5-405a-a315-bf8de0e69093 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:16.009264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbb35-1fa5-405a-a315-bf8de0e69093 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:16.009264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbb35-1fa5-405a-a315-bf8de0e69093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:16.028985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d98bbb35-1fa5-405a-a315-bf8de0e69093 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:16.030207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d98bbb35-1fa5-405a-a315-bf8de0e69093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:16.038142 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1448/2907] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:16.059413 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:16.060783 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:16.075754 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb870-bc23-4721-a940-ab5ab159a5c3 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:16.081197 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:16.081795 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:16.082079 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:16.082393 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:16.091304 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:16.092869 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:16.102177 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1460/2908] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:19.269544 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19b3b-aee0-42cb-9dad-f781384f906b None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:19.270093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19b3b-aee0-42cb-9dad-f781384f906b None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:19.270093 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca19b3b-aee0-42cb-9dad-f781384f906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:19.291415 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-4ca19b3b-aee0-42cb-9dad-f781384f906b None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:19.292667 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-4ca19b3b-aee0-42cb-9dad-f781384f906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:19.301003 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1449/2909] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:19.324024 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:19.338753 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9539-9d33-43f4-9ca7-7aaa8db644c2 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:19.344543 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:19.345135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:19.345414 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:19.345688 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:19.353931 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:19.355546 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:19.365045 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1461/2910] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:22.361682 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01822-ea1e-4068-b87c-1a018dd0782d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:22.362214 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01822-ea1e-4068-b87c-1a018dd0782d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:22.362352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01822-ea1e-4068-b87c-1a018dd0782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:22.381929 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-08d01822-ea1e-4068-b87c-1a018dd0782d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:22.383712 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-08d01822-ea1e-4068-b87c-1a018dd0782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:22.391595 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1450/2911] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:22.413460 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:22.424622 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55d158-de22-47ba-8bc7-965a10e28c78 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:22.430573 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:22.431163 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:22.431444 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:22.431718 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:22.439752 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:22.441323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:22.453269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1462/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:17:26.570824 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe41-782b-497d-a882-4144a7591a07 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:26.571468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe41-782b-497d-a882-4144a7591a07 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:26.571468 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe41-782b-497d-a882-4144a7591a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:26.592061 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-780dbe41-782b-497d-a882-4144a7591a07 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:26.593401 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-780dbe41-782b-497d-a882-4144a7591a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:26.602933 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1451/2913] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:26.626730 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:26.637798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac1c-9f17-4251-b011-76568ac269be service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:26.643671 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:26.644268 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:26.644548 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:26.644818 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:26.653219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:26.654813 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:26.664554 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1463/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:29.715021 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:29.715504 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:29.715613 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:29.735660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:29.736853 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:29.745272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1452/2915] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:29.766876 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:29.778100 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0427-d39f-4886-9b2e-4b0aa1d29094 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:29.783644 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:29.784239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:29.784524 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:29.784803 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:29.793398 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:29.795029 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1545-2d96-45e9-88a7-7fefd2ef126a service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:29.804353 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1464/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:39.587113 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:39.594071 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=43 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:17:39.602086 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbdd88-b092-42a6-a0c4-f3dbeedf6394 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:39.607832 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:39.608532 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:39.608872 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:39.609336 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:39.612534 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:39.626097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:39.627713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:39.639769 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1453/2917] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:39.800127 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=64 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:17:44.869737 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:44.870372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:44.870372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:44.890140 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] MFA Rules not processed for user `5c87e2301f4b4cf4ac67a8f97b02d145`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:17:44.891563 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:44.945070 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1465/2918] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:17:45.179208 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:45.181147 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:45.192517 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb47d-33c6-4a1a-8dd4-30af9bdd6aa6 service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:45.196816 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:45.197422 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:45.197703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:45.197976 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:45.199697 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:45.209183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:45.210564 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30ec5f-27de-42f2-96a5-31e378591b90 service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:45.218760 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1454/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:45.542050 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:17:45.543591 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:45.620046 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35546aa-8a54-499b-a95a-4852e5ff1e79 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:17:45.624969 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:17:45.625578 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:17:45.625862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:17:45.626138 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:17:45.627860 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:17:45.639308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:17:45.640895 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:17:45.651798 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1466/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:17:55.214970 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=11 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:17:55.646580 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=57 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:01.688912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764fe-97f9-4c65-950f-03ee6b4b673d None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:01.689582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764fe-97f9-4c65-950f-03ee6b4b673d None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:01.689582 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc764fe-97f9-4c65-950f-03ee6b4b673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:01.710305 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bdc764fe-97f9-4c65-950f-03ee6b4b673d None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:01.711750 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bdc764fe-97f9-4c65-950f-03ee6b4b673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:01.720311 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1455/2921] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:01.747130 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:01.760081 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bca03-49c0-4a5b-9461-6f5dedde6d42 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:01.765418 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:01.766004 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:01.766301 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:01.766577 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:01.775330 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:01.776921 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:01.786216 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1467/2922] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:04.968558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c92f8-27c3-4d6c-a1df-5e7a16fc0189 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:04.969112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c92f8-27c3-4d6c-a1df-5e7a16fc0189 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:04.969112 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c92f8-27c3-4d6c-a1df-5e7a16fc0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:04.990489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-bb6c92f8-27c3-4d6c-a1df-5e7a16fc0189 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:04.991727 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-bb6c92f8-27c3-4d6c-a1df-5e7a16fc0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:05.000256 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1456/2923] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:05.021654 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:05.033750 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cbf5-969f-49a2-befe-d4aa8fa923cf service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:05.039794 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:05.040391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:05.040672 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:05.040948 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:05.049152 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:05.050757 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:05.060788 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1468/2924] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:08.055161 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638dc5-2812-4dd9-a24f-e7736b5d13c4 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:08.055691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638dc5-2812-4dd9-a24f-e7736b5d13c4 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:08.055691 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638dc5-2812-4dd9-a24f-e7736b5d13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:08.076183 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-a2638dc5-2812-4dd9-a24f-e7736b5d13c4 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:08.077399 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-a2638dc5-2812-4dd9-a24f-e7736b5d13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:08.085361 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1457/2925] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:08.108346 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:08.120487 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495d3d7-17c6-4e84-b58d-c744afc71105 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:08.125968 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:08.126609 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:08.126892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:08.127194 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:08.135920 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:08.137700 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:08.148610 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1469/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:18:12.254529 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d36d-1ad9-4405-812b-e08b8dbf8bef None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:12.255014 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d36d-1ad9-4405-812b-e08b8dbf8bef None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:12.255123 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d36d-1ad9-4405-812b-e08b8dbf8bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:12.275342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-d024d36d-1ad9-4405-812b-e08b8dbf8bef None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:12.276569 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-d024d36d-1ad9-4405-812b-e08b8dbf8bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:12.284579 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1458/2927] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:12.308399 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:12.320077 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbfc84-6184-4fc1-870b-76651f511b28 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:12.325747 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:12.326919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:12.326919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:12.326919 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:12.336055 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:12.337648 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:12.351513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1470/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 10:18:16.467817 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:16.468393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:16.468393 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:16.487417 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:16.488615 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:16.497005 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1459/2929] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Sep 21 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:16.520556 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:16.531814 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e016-6ae5-456a-8171-60eff0474e7c service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:16.537227 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:16.537827 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:16.538110 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:16.538456 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:16.546567 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:16.548144 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:16.557937 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1471/2930] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:26.482135 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=15 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:26.553269 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=30 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:45.473365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:45.474808 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:45.489979 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd7728-f688-4d06-9913-6f411ef674ad None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:45.495143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:45.496423 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:45.496703 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:45.497081 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:45.498745 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:45.511294 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:45.512985 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:45.527425 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1460/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:45.550038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:45.552273 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:45.567035 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532413e-b0c6-44cd-be25-710b1063a520 service nova] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:45.572059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:45.573102 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:45.573205 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:45.573475 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] PATH_INFO: `/v3/users/5c87e2301f4b4cf4ac67a8f97b02d145` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:45.575913 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c87e2301f4b4cf4ac67a8f97b02d145)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:45.577823 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:45.626036 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c87e2301f4b4cf4ac67a8f97b02d145'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.626717 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c87e2301f4b4cf4ac67a8f97b02d145'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.633544 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c87e2301f4b4cf4ac67a8f97b02d145'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.650469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c87e2301f4b4cf4ac67a8f97b02d145'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.651185 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-be3869fe-ba32-4f77-8a83-2afd426dcb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c87e2301f4b4cf4ac67a8f97b02d145'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.665168 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1472/2932] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:18:45 2022] DELETE /identity/v3/users/5c87e2301f4b4cf4ac67a8f97b02d145 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:18:45.853352 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:45.864984 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc11b5b-ecdf-40d6-958d-5d2120272041 service placement] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:45.928520 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:45.929187 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:45.929558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:45.929819 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] PATH_INFO: `/v3/projects/d64de2b1589f458db6b7239098a8bc98` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:45.930990 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64de2b1589f458db6b7239098a8bc98)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:45.933011 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:45.986751 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64de2b1589f458db6b7239098a8bc98', 'request_id': 'req-d32aa9a3-f515-45fc-8766-024971b17fb4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:45.993073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64de2b1589f458db6b7239098a8bc98', 'request_id': 'req-d32aa9a3-f515-45fc-8766-024971b17fb4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:46.001066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64de2b1589f458db6b7239098a8bc98', 'request_id': 'req-d32aa9a3-f515-45fc-8766-024971b17fb4'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:46.012136 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] The token cache is being invalidate because project d64de2b1589f458db6b7239098a8bc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:18:46.012434 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:46.013078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-d32aa9a3-f515-45fc-8766-024971b17fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:46.014624 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1461/2933] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:18:45 2022] DELETE /identity/v3/projects/d64de2b1589f458db6b7239098a8bc98 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:18:46.019665 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.019890 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.020165 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.040496 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:46.041712 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:46.115038 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1473/2934] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:46.122882 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.123164 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.123440 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.148349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:46.149573 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:46.158216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1462/2935] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:46.162942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.173184 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eba05-aff8-499d-9903-4c4b5604cb2e None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.177962 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.178616 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.178896 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.179171 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.179855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 10:18:46.180198 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.181978 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.194821 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1474/2936] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Sep 21 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 10:18:46.200079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.209834 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e508-a635-48b7-932f-d5a0fff68271 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.215572 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.216184 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.216713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.216982 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.217609 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.219660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.262502 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1463/2937] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Sep 21 10:18:46 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 10:18:46.268663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.282855 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ca72f-aa82-46db-aa8c-9b362edc5367 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.340492 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.341098 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.341635 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.341910 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.342574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.344479 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.352419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:46.367656 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1475/2938] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Sep 21 10:18:46 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 10:18:46.372605 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.382956 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69168-5225-40a1-b643-1e1a62446931 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.388259 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.389019 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.389297 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.389568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.390216 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.391826 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.401737 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1464/2939] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:18:46.405817 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.415678 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ca5c4-10c2-4187-814d-759325f65bdf admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.420366 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.420958 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.421239 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.421514 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.422154 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.423773 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb508-b63e-4d0b-8ffb-d2b0772d4d8b admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.434663 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1476/2940] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Sep 21 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 10:18:46.438946 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.449912 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e252a-effb-4c9d-b229-009076a13b20 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.455753 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.456438 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.456717 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.456991 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] PATH_INFO: `/v3/projects/5cab4303861c4b189515d33413b18471/users/a4f8cdea706c4a8bb0a91d4d6710839d/roles/67aa14b3cada47e5abb505ee855977d3` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.472168 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cab4303861c4b189515d33413b18471, user_id=a4f8cdea706c4a8bb0a91d4d6710839d, role_id=67aa14b3cada47e5abb505ee855977d3)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.474848 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.488260 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1465/2941] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Sep 21 10:18:46 2022] PUT /identity/v3/projects/5cab4303861c4b189515d33413b18471/users/a4f8cdea706c4a8bb0a91d4d6710839d/roles/67aa14b3cada47e5abb505ee855977d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 10:18:46.498853 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] REQUEST_METHOD: `POST` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.499135 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.499406 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.527085 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.auth.core [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] MFA Rules not processed for user `a4f8cdea706c4a8bb0a91d4d6710839d`. Rule list: `[]` (Enabled: `True`). {{(pid=81475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:46.528283 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:46.593585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1477/2942] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:46.604992 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:46.606818 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:46.621822 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:46.668489 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da15cc-d51e-4cfe-b893-f493d641c94c admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:46.672516 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c7227deb9048398d33ff330b8df8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:46.673116 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:46.673392 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:46.673661 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:46.681977 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:46.684060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d969aa6-cc98-4039-815c-472721e293b0 service cinder] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:46.693726 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1466/2943] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:56.590359 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:56.688939 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=20 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:18:56.996107 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:57.059314 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ba6ce-8273-4b47-8d58-27f5bb0d6957 None None] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:57.063721 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:57.064347 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:57.064626 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:57.064898 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] PATH_INFO: `/v3/users/a4f8cdea706c4a8bb0a91d4d6710839d` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:57.066001 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f8cdea706c4a8bb0a91d4d6710839d)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:57.067984 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:57.113423 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f8cdea706c4a8bb0a91d4d6710839d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.113995 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f8cdea706c4a8bb0a91d4d6710839d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.121308 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f8cdea706c4a8bb0a91d4d6710839d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.132902 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f8cdea706c4a8bb0a91d4d6710839d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.133574 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f8cdea706c4a8bb0a91d4d6710839d'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.148230 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1478/2944] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:18:56 2022] DELETE /identity/v3/users/a4f8cdea706c4a8bb0a91d4d6710839d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:18:57.151685 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] REQUEST_METHOD: `POST` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:57.151981 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:57.152263 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:57.171743 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.auth.core [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] MFA Rules not processed for user `9984ac48f53d4200ac584a0c0d9f52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 10:18:57.172962 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:57.230780 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1467/2945] 10.222.0.20 () {58 vars in 958 bytes} [Wed Sep 21 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 10:18:57.240532 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:57.241942 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:57.298963 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e051-1425-48f4-8c40-17005be30c99 admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:57.302980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:57.303595 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:57.303879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:57.304155 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:57.313909 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:57.315379 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:57.324852 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1479/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:18:57.605209 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:18:57.606893 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:18:57.619894 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb09a7d-7359-46cd-b550-4f25a7824fd2 None None] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:18:57.625173 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:18:57.625854 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:18:57.626134 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:18:57.626436 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] PATH_INFO: `/v3/projects/5cab4303861c4b189515d33413b18471` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:18:57.627660 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cab4303861c4b189515d33413b18471)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:18:57.629606 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:18:57.683804 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cab4303861c4b189515d33413b18471', 'request_id': 'req-02b246db-b73f-40bc-a179-9d9b689667b6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.692341 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cab4303861c4b189515d33413b18471', 'request_id': 'req-02b246db-b73f-40bc-a179-9d9b689667b6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.701841 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cab4303861c4b189515d33413b18471', 'request_id': 'req-02b246db-b73f-40bc-a179-9d9b689667b6'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.715345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] The token cache is being invalidate because project 5cab4303861c4b189515d33413b18471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:18:57.715699 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.716284 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:18:57.718070 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1468/2947] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:18:57 2022] DELETE /identity/v3/projects/5cab4303861c4b189515d33413b18471 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:19:07.320701 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:19:07.711207 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:19:40.943729 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:19:40.945057 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:41.016667 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a237-1e2e-4f80-a4f2-b0637c4584c7 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:19:41.087526 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:19:41.088372 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:19:41.088661 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:19:41.089150 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:19:41.092329 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:41.104059 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:19:41.105743 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:19:41.120469 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1480/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:19:41.692870 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:19:41.694558 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:41.769587 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b246db-b73f-40bc-a179-9d9b689667b6 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:19:41.773269 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:19:41.773885 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:19:41.774188 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:19:41.774602 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:19:41.776412 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:41.787060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:19:41.788522 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:19:41.797986 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1469/2949] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:19:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:19:42.906109 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:19:42.907585 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:42.919141 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b6e7-8d8c-4da9-a1ee-de0f021c7ddf service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:19:42.922789 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:19:42.923391 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:19:42.923668 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:19:42.924096 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:19:42.925829 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:42.999321 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:19:43.000760 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:19:43.012374 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1481/2950] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:19:44.183097 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:19:44.184862 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:44.219487 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00de6bf-0b3f-493f-8e47-e9b1339cf92e service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:19:44.229062 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be328584a6549aeb096ab9b852daf9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:19:44.230124 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:19:44.231010 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:19:44.231365 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:19:44.233604 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:19:44.247647 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:19:44.249406 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:19:44.265568 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1470/2951] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:19:53.007020 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:19:54.264878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=32 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:21:39.786751 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:39.795461 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71546a-48ea-44c4-a08f-53154ed7f260 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:39.799086 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:39.799684 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:39.799965 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:39.800244 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:39.802093 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:39.861017 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:39.862491 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:39.871331 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1482/2952] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:21:40.995343 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:41.004713 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cda54-7309-410a-b1af-e8282e68771e service nova] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:41.008342 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:41.009079 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:41.009366 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:41.009641 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:41.011480 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:41.025382 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:41.026907 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:41.039060 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1471/2953] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:21:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:21:42.270892 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:42.280274 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1beb4-1b23-43ea-aefb-a4131267eaa8 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:42.283916 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:42.284513 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:42.284790 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:42.285062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:42.286816 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:42.300103 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:42.301459 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:42.314946 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1483/2954] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:21:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:21:44.924486 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:44.934090 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a78db-5bfe-430d-9714-c34346b8251f service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:44.937966 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd823e9d31401459cbf02d9360e9c8e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:44.938665 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:44.938874 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:44.939143 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:44.941427 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:45.004617 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:45.006078 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:45.016073 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1472/2955] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:21:48.119095 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:48.120636 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:48.137005 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be18f7-045b-4d15-9d04-eb182dc48dc0 service neutron] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:48.144419 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:48.145603 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] REQUEST_METHOD: `GET` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:48.146293 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:48.146511 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:48.150702 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:48.166219 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:48.168281 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:48.182064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1484/2956] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:21:51.109169 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:51.110705 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:51.125677 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d14209-da2d-4dd7-86d9-8744edd13cbf service neutron] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:51.131175 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:51.131973 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:51.132349 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:51.132711 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] PATH_INFO: `/v3/users/6b07a80c17fc4f42816aee83dd52fdde` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:51.134101 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b07a80c17fc4f42816aee83dd52fdde)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:51.136405 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:51.188533 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b07a80c17fc4f42816aee83dd52fdde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.189185 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b07a80c17fc4f42816aee83dd52fdde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.196229 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b07a80c17fc4f42816aee83dd52fdde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.209345 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b07a80c17fc4f42816aee83dd52fdde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.210087 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b07a80c17fc4f42816aee83dd52fdde'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.225053 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1473/2957] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:21:51 2022] DELETE /identity/v3/users/6b07a80c17fc4f42816aee83dd52fdde => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:21:51.416187 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:51.433090 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eafcad-776b-4408-87ea-c5edb9830653 service placement] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:51.491759 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:51.492299 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:51.492581 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:51.492862 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] PATH_INFO: `/v3/projects/b4a4f09774b1428082b2c886e371e684` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:51.493980 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a4f09774b1428082b2c886e371e684)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:51.495927 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:51.541341 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a4f09774b1428082b2c886e371e684', 'request_id': 'req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.548471 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a4f09774b1428082b2c886e371e684', 'request_id': 'req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.555094 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a4f09774b1428082b2c886e371e684', 'request_id': 'req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.565365 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] The token cache is being invalidate because project b4a4f09774b1428082b2c886e371e684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:21:51.565651 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.566317 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.567770 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1485/2958] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:21:51 2022] DELETE /identity/v3/projects/b4a4f09774b1428082b2c886e371e684 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:21:51.571823 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:51.573236 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:51.586265 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8388cbb-c757-460d-962c-f7ccc1d3e4fa admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:51.633814 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:21:51.644362 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:51.645255 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:51.646106 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:51.646484 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] PATH_INFO: `/v3/users/1bbab3d8c37d4953accbc00af8137571` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:51.647811 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbab3d8c37d4953accbc00af8137571)` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:51.649761 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:51.695219 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbab3d8c37d4953accbc00af8137571'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.695878 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbab3d8c37d4953accbc00af8137571'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.704301 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbab3d8c37d4953accbc00af8137571'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.720238 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbab3d8c37d4953accbc00af8137571'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.721560 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.notifications [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbab3d8c37d4953accbc00af8137571'} {{(pid=81476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:51.735398 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1474/2959] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Sep 21 10:21:51 2022] DELETE /identity/v3/users/1bbab3d8c37d4953accbc00af8137571 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:21:51.912064 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Authenticating user token {{(pid=81475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:21:51.913495 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.fernet_utils [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:21:51.928186 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:21:51.933956 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0c65-1ef1-4b94-b769-2bc90ed8503f admin admin] Validating token access rules against request {{(pid=81475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:21:51.993395 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9984ac48f53d4200ac584a0c0d9f52b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e542a5235d4f308d797e26281f9ea9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:21:51.994028 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:21:51.994343 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:21:51.994623 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] PATH_INFO: `/v3/projects/db4863651732475a92863d5e0d9ed4bc` {{(pid=81475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:21:51.995735 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4863651732475a92863d5e0d9ed4bc)` {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:21:51.997642 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] RBAC: Authorization granted {{(pid=81475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:21:52.043972 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4863651732475a92863d5e0d9ed4bc', 'request_id': 'req-5749360c-11ed-4062-b744-94c92d4806b2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:52.051323 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4863651732475a92863d5e0d9ed4bc', 'request_id': 'req-5749360c-11ed-4062-b744-94c92d4806b2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:52.057572 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4863651732475a92863d5e0d9ed4bc', 'request_id': 'req-5749360c-11ed-4062-b744-94c92d4806b2'} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:52.068589 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] The token cache is being invalidate because project db4863651732475a92863d5e0d9ed4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 10:21:52.068879 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:52.069515 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG keystone.notifications [None req-5749360c-11ed-4062-b744-94c92d4806b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 10:21:52.071042 dv-cinder-855479-2-smb devstack@keystone.service[81475]: [pid: 81475|app: 0|req: 1486/2960] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Sep 21 10:21:51 2022] DELETE /identity/v3/projects/db4863651732475a92863d5e0d9ed4bc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 10:22:01.732290 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:22:02.066062 dv-cinder-855479-2-smb devstack@keystone.service[81475]: DEBUG dbcounter [-] [81475] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 10:25:17.453066 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Authenticating user token {{(pid=81476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 10:25:17.454513 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:25:17.597335 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16a06-bc49-4e5f-a874-6517df4be4a4 admin admin] Validating token access rules against request {{(pid=81476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 10:25:17.659380 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16e15230c59475eba52906ad0643fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac10ab875b0e461494d906123bab7ede', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 10:25:17.659987 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] REQUEST_METHOD: `GET` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 10:25:17.660264 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] SCRIPT_NAME: `/identity` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 10:25:17.660535 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 10:25:17.662285 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.fernet_utils [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 10:25:17.673689 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 10:25:17.675272 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7ad3-e4f8-4a54-9c50-9465061ac15a service placement] RBAC: Authorization granted {{(pid=81476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 10:25:17.685676 dv-cinder-855479-2-smb devstack@keystone.service[81476]: [pid: 81476|app: 0|req: 1475/2961] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Sep 21 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 10:25:27.680828 dv-cinder-855479-2-smb devstack@keystone.service[81476]: DEBUG dbcounter [-] [81476] Writing DB stats keystone:SELECT=89 {{(pid=81476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}